Apr 24 19:48:04 devstack cinder-volume[71594]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 24 19:48:04 devstack cinder-volume[71594]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 19:48:04 devstack cinder-volume[71594]: we strongly recommend against using it for new projects.
Apr 24 19:48:04 devstack cinder-volume[71594]: If you are already using Eventlet, we recommend migrating to a different
Apr 24 19:48:04 devstack cinder-volume[71594]: framework.  For more detail see
Apr 24 19:48:04 devstack cinder-volume[71594]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 19:48:04 devstack cinder-volume[71594]:   import eventlet  # noqa
Apr 24 19:48:06 devstack cinder-volume[71594]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=71594) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 19:48:06 devstack cinder-volume[71594]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=71594) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 19:48:06 devstack cinder-volume[71594]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=71594) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 19:48:06 devstack cinder-volume[71594]: INFO dbcounter [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Registered counter for database cinder
Apr 24 19:48:06 devstack cinder-volume[71594]: DEBUG oslo_db.sqlalchemy.engines [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71594) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG dbcounter [-] [71594] Writer thread running {{(pid=71594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 19:48:07 devstack cinder-volume[71594]: INFO cinder.rpc [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 24 19:48:07 devstack cinder-volume[71594]: INFO cinder.rpc [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_db.sqlalchemy.engines [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71594) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 19:48:07 devstack cinder-volume[71594]: INFO cinder.volume.manager [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Determined volume DB was empty at startup.
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG cinder.volume.manager [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=71594) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 24 19:48:07 devstack cinder-volume[71594]: INFO cinder.volume.manager [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 24 19:48:07 devstack cinder-volume[71594]: WARNING stevedore.named [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 24 19:48:07 devstack cinder-volume[71594]: WARNING castellan.key_manager [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 19:48:07 devstack cinder-volume[71594]: WARNING cinder.keymgr.conf_key_mgr [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG cinder.volume.drivers.lvm [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=71594) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_concurrency.processutils [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=71594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_concurrency.processutils [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] CMD "cinder-rtstool verify" returned: 0 in 0.251s {{(pid=71594) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_db.sqlalchemy.engines [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71594) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 19:48:07 devstack cinder-volume[71594]: INFO cinder.rpc [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 24 19:48:07 devstack cinder-volume[71594]: INFO cinder.rpc [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 24 19:48:07 devstack cinder-volume[71594]: WARNING stevedore.named [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 24 19:48:07 devstack cinder-volume[71594]: WARNING castellan.key_manager [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 19:48:07 devstack cinder-volume[71594]: INFO cinder.volume.manager [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_db.sqlalchemy.engines [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71594) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 19:48:07 devstack cinder-volume[71594]: INFO oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Starting 1 workers
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Started child 71707 {{(pid=71594) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Full set of CONF: {{(pid=71594) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] ******************************************************************************** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Configuration options gathered from: {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 24 19:48:07 devstack cinder-volume[71707]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] ================================================================================ {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] allow_availability_zone_fallback = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] allow_compression_on_image_upload = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] allowed_direct_url_schemes     = [] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] api_rate_limit                 = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] auth_strategy                  = keystone {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] az_cache_duration              = 3600 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_availability_zone      = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_host                   = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_name                   = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_stats_polling_interval = 60 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backup_api_class               = cinder.backup.api.API {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backup_name_template           = backup-%s {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backup_use_same_host           = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backup_use_temp_snapshot       = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] chap_password                  = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] chap_username                  =  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cinder_internal_tenant_project_id = 1dd4f42c2f8b48dc8230af20278a8e52 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cinder_internal_tenant_user_id = dc6b72fe2adf4bfb8f3f69518db32112 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cloned_volume_same_az          = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cluster                        = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] compression_format             = gzip {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] compute_api_class              = cinder.compute.nova.API {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] config_dir                     = [] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] config_source                  = [] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] control_exchange               = openstack {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] debug                          = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] default_availability_zone      = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] default_group_type             = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] default_volume_type            = lvmdriver-1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] disk_geometry                  = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] driver_client_cert             = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] driver_client_cert_key         = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] driver_data_namespace          = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] driver_ssl_cert_path           = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71707]: INFO cinder.volume.manager [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] driver_ssl_cert_verify         = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] driver_use_ssl                 = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] enable_force_upload            = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] enable_new_services            = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] enable_unsupported_driver      = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] enforce_multipath_for_image_xfer = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] filter_function                = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance_api_insecure            = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance_api_servers             = ['http://192.168.122.91/image'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance_api_ssl_compression     = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance_ca_certificates_file    = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance_catalog_info            = image:glance:publicURL {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance_certfile                = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance_keyfile                 = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance_num_retries             = 3 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance_request_timeout         = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] goodness_function              = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] graceful_shutdown_timeout      = 5 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] group_api_class                = cinder.group.api.API {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] host                           = devstack {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] image_compress_on_upload       = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] image_conversion_address_space_limit = 1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] image_conversion_cpu_limit     = 60 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] image_conversion_disable       = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] image_upload_use_cinder_backend = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] image_upload_use_internal_tenant = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] image_volume_cache_enabled     = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] image_volume_cache_max_count   = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] image_volume_cache_max_size_gb = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] init_host_max_objects_retrieval = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] iscsi_target_flags             =  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] iscsi_write_cache              = on {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] iser_helper                    = tgtadm {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] iser_ip_address                = 192.168.122.91 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] iser_port                      = 3260 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] log_color                      = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] log_config_append              = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] log_dir                        = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] log_file                       = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] log_options                    = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] log_rotate_interval            = 1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] log_rotate_interval_type       = days {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] log_rotation_type              = none {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] max_age                        = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] max_logfile_count              = 30 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] max_logfile_size_mb            = 200 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] max_over_subscription_ratio    = 20.0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] message_reap_interval          = 86400 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] message_ttl                    = 2592000 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] migration_create_volume_timeout_secs = 300 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] monkey_patch                   = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] monkey_patch_modules           = [] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] my_ip                          = 192.168.122.91 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] no_snapshot_gb_quota           = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] num_iser_scan_tries            = 3 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] num_shell_tries                = 3 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] num_volume_device_scan_tries   = 3 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] nvmeof_conn_info_version       = 1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] nvmet_ns_id                    = 10 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] nvmet_port_id                  = 1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] osapi_max_limit                = 1000 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] osapi_volume_ext_list          = [] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] osapi_volume_listen_port       = 8776 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] osapi_volume_use_ssl           = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] osapi_volume_workers           = 2 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] per_volume_size_limit          = -1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] periodic_fuzzy_delay           = 60 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] periodic_interval              = 60 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] public_endpoint                = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] publish_errors                 = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] quota_backup_gigabytes         = 1000 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] quota_backups                  = 10 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] quota_gigabytes                = 1000 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] quota_groups                   = 10 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] quota_snapshots                = 10 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] quota_volumes                  = 10 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] rate_limit_burst               = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] rate_limit_except_level        = CRITICAL {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] rate_limit_interval            = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] reinit_driver_count            = 3 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] replication_device             = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] report_discard_supported       = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] report_interval                = 120 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] reservation_clean_interval     = 86400 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] reservation_expire             = 86400 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] reserved_image_namespaces      = [] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] reserved_percentage            = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] rpc_response_timeout           = 120 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] run_external_periodic_tasks    = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] scst_target_driver             = iscsi {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] scst_target_iqn_name           = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] service_down_time              = 720 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] shell_completion               = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] snapshot_name_template         = snapshot-%s {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] snapshot_same_host             = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] split_loggers                  = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] state_path                     = /opt/stack/data/cinder {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] storage_availability_zone      = nova {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] storage_protocol               = iSCSI {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] syslog_log_facility            = LOG_USER {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] target_helper                  = lioadm {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] target_ip_address              = 192.168.122.91 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] target_port                    = 3260 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] target_protocol                = iscsi {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] target_secondary_ip_addresses  = [] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] trace_flags                    = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] transport_url                  = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] until_refresh                  = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] use_chap_auth                  = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] use_default_quota_class        = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] use_journal                    = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] use_json                       = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] use_multipath_for_image_xfer   = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] use_stderr                     = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] use_syslog                     = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] verify_glance_signatures       = enabled {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] volume_api_class               = cinder.volume.api.API {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] volume_backend_name            = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] volume_clear                   = zero {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] volume_clear_ionice            = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] volume_clear_size              = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] volume_copy_bps_limit          = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] volume_dd_blocksize            = 1M {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] volume_name_template           = volume-%s {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] volume_service_inithost_offload = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] volume_usage_audit_period      = month {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] zoning_mode                    = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_concurrency.disable_process_locking = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.admin_password = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.admin_token = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.admin_user  = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.auth_port   = 35357 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.auth_protocol = https {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.auth_section = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.auth_type   = password {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.auth_uri    = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.auth_version = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.cache       = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.certfile    = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.delay_auth_decision = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.http_connect_timeout = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.identity_uri = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.include_service_catalog = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.insecure    = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.interface   = public {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.keyfile     = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_password =  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack sudo[71711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack sudo[71711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcache_username =  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.region_name = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.service_token_roles_required = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.service_type = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.token_cache_time = 300 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.91/identity {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.backend                  = dogpile.cache.null {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.backend_argument         = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.backend_expiration_time  = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.config_prefix            = cache.oslo {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.debug_cache_backend      = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.enable_retry_client      = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.enable_socket_keepalive  = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.enabled                  = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.enforce_fips_mode        = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.expiration_time          = 600 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.hashclient_retry_attempts = 2 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.memcache_dead_retry      = 300 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.memcache_sasl_enabled    = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.password                 = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.proxies                  = [] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.redis_db                 = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.redis_sentinel_service_name = mymaster {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.redis_server             = localhost:6379 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.retry_attempts           = 2 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.retry_delay              = 0.0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.socket_keepalive_count   = 1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.socket_keepalive_idle    = 1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.socket_keepalive_interval = 1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.socket_timeout           = 1.0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.tls_allowed_ciphers      = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.tls_cafile               = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.tls_certfile             = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.tls_enabled              = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.tls_keyfile              = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cache.username                 = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] coordination.backend_url       = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.asyncio_connection    = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.asyncio_slave_connection = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.backend               = sqlalchemy {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.connection            = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.connection_debug      = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.connection_parameters =  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.connection_recycle_time = 3600 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.connection_trace      = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.db_inc_retry_interval = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.db_max_retries        = 20 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.db_max_retry_interval = 10 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.db_retry_interval     = 1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.max_overflow          = 50 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.max_pool_size         = 5 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.max_retries           = 10 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.mysql_wsrep_sync_wait = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.pool_timeout          = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.retry_interval        = 10 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.slave_connection      = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.sqlite_synchronous    = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.synchronous_reader    = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] database.use_db_reconnect      = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] profiler.connection_string     = messaging:// {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] profiler.enabled               = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] profiler.es_doc_type           = notification {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] profiler.es_scroll_size        = 10000 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] profiler.es_scroll_time        = 2m {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] profiler.filter_error_trace    = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] profiler.hmac_keys             = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] profiler.sentinel_service_name = mymaster {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] profiler.socket_timeout        = 0.1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] profiler.trace_requests        = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] profiler.trace_sqlalchemy      = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] profiler_jaeger.process_tags   = {} {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] profiler_jaeger.service_name_prefix = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] profiler_otlp.service_name_prefix = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_policy.enforce_new_defaults = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: WARNING oslo_config.cfg [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_policy.enforce_scope      = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_policy.policy_default_rule = default {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] privsep_osbrick.group          = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] privsep_osbrick.helper_command = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] privsep_osbrick.user           = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cinder_sys_admin.group         = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cinder_sys_admin.helper_command = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] cinder_sys_admin.user          = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] service_user.auth_section      = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] service_user.auth_type         = password {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] service_user.cafile            = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] service_user.certfile          = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] service_user.collect_timing    = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] service_user.insecure          = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] service_user.keyfile           = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] service_user.send_service_user_token = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] service_user.split_loggers     = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] service_user.timeout           = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance.auth_section            = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance.auth_type               = password {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance.certfile                = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance.collect_timing          = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance.insecure                = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance.keyfile                 = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance.region_name             = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance.split_loggers           = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] glance.timeout                 = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.backend_availability_zone = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.chap_password = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.chap_username =  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.disk_geometry = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.driver_client_cert = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.driver_client_cert_key = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.driver_data_namespace = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.driver_use_ssl = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.enable_unsupported_driver = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.extra_capabilities = {} {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.filter_function = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.goodness_function = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.iscsi_target_flags =  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.iscsi_write_cache = on {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.iser_helper   = tgtadm {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.iser_ip_address = 192.168.122.91 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.iser_port     = 3260 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.lvm_share_target = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.lvm_type      = auto {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.num_shell_tries = 3 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.nvmet_port_id = 1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.replication_device = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.report_discard_supported = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.reserved_percentage = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.scst_target_driver = iscsi {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.scst_target_iqn_name = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.storage_protocol = iSCSI {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.target_helper = tgtadm {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.target_ip_address = 192.168.122.91 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.target_port   = 3260 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.target_protocol = iscsi {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.trace_flags   = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.unique_fqdn_network = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.use_chap_auth = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.volume_backend_name = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.volume_clear  = zero {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.volume_clear_ionice = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.volume_clear_size = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_reports.file_event_handler = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_reports.log_dir           = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.backend_availability_zone = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.backend_host       = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.chap_password      = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.chap_username      = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.disk_geometry      = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.driver_client_cert = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.driver_data_namespace = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.extra_capabilities = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.filter_function    = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.goodness_function  = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.iser_helper        = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.iser_ip_address    = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.iser_port          = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.iser_target_prefix = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.lvm_share_target   = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.lvm_type           = auto {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.num_shell_tries    = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.replication_device = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.report_discard_supported = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.reserved_percentage = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.scst_target_driver = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.storage_protocol   = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.target_helper      = lioadm {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.target_ip_address  = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.target_port        = 3260 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.trace_flags        = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.use_chap_auth      = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.volume_clear       = zero {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.volume_clear_size  = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] lvmdriver-1.volumes_dir        = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_notifications.driver = [] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_notifications.retry = -1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] key_manager.fixed_key          = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.barbican_api_version  = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.barbican_endpoint     = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.barbican_endpoint_type = public {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.barbican_region_name  = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.cafile                = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.certfile              = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.collect_timing        = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.insecure              = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.keyfile               = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.number_of_retries     = 60 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.retry_delay           = 1 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.send_service_user_token = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.split_loggers         = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.timeout               = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.verify_ssl            = True {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican.verify_ssl_path       = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican_service_user.auth_section = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican_service_user.auth_type = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican_service_user.cafile   = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican_service_user.certfile = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican_service_user.collect_timing = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican_service_user.insecure = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican_service_user.keyfile  = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican_service_user.split_loggers = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] barbican_service_user.timeout  = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] vault.approle_role_id          = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] vault.approle_secret_id        = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] vault.kv_mountpoint            = secret {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] vault.kv_path                  = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] vault.kv_version               = 2 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] vault.namespace                = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] vault.root_token_id            = **** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] vault.ssl_ca_crt_file          = None {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] vault.timeout                  = 60.0 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] vault.use_ssl                  = False {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:48:07 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] ******************************************************************************** {{(pid=71594) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 24 19:48:08 devstack sudo[71711]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:08 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:08 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:08 devstack sudo[71903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 19:48:08 devstack sudo[71903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:08 devstack sudo[71903]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:08 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.555s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:08 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 19:48:08 devstack cinder-volume[71707]: INFO cinder.brick.local_dev.lvm [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 24 19:48:08 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:08 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:08 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:08 devstack sudo[72106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 19:48:08 devstack sudo[72106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:09 devstack sudo[72106]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:09 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.747s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:09 devstack cinder-volume[71707]: DEBUG cinder.brick.local_dev.lvm [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=71707) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 24 19:48:09 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:09 devstack sudo[72232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 19:48:09 devstack sudo[72232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:10 devstack sudo[72232]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:10 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.960s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:10 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:10 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:10 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:10 devstack sudo[72395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 19:48:10 devstack sudo[72395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:11 devstack sudo[72395]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.493s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:11 devstack sudo[72399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 24 19:48:11 devstack sudo[72399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:11 devstack sudo[72399]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.500s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:11 devstack sudo[72403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 19:48:11 devstack sudo[72403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:12 devstack sudo[72403]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:12 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:12 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:12 devstack sudo[72410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 19:48:12 devstack sudo[72410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:12 devstack sudo[72410]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:12 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:12 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:12 devstack sudo[72415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 19:48:12 devstack sudo[72415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:12 devstack sudo[72415]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:12 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:12 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:13 devstack sudo[72418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 19:48:13 devstack sudo[72418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:13 devstack sudo[72418]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:13 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.499s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:13 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:13 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:13 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:13 devstack sudo[72422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 19:48:13 devstack sudo[72422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:14 devstack sudo[72422]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:14 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.615s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:14 devstack cinder-volume[71707]: INFO cinder.volume.drivers.lvm [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 24 19:48:14 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:14 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:14 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:14 devstack sudo[72484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 19:48:14 devstack sudo[72484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:14 devstack sudo[72484]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:14 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.478s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:14 devstack cinder-volume[71707]: DEBUG cinder.volume.drivers.lvm [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Updating volume stats {{(pid=71707) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 19:48:14 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:14 devstack sudo[72546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 19:48:14 devstack sudo[72546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:15 devstack sudo[72546]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:15 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:15 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:15 devstack sudo[72686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 19:48:15 devstack sudo[72686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:15 devstack sudo[72686]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:15 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.560s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:15 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:15 devstack sudo[72691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 19:48:15 devstack sudo[72691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:16 devstack sudo[72691]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:16 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.486s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:16 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:16 devstack sudo[72697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 19:48:16 devstack sudo[72697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:16 devstack sudo[72697]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:16 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.501s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:16 devstack cinder-volume[71707]: INFO cinder.volume.driver [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Driver hasn't implemented _init_vendor_properties()
Apr 24 19:48:16 devstack cinder-volume[71707]: DEBUG cinder.volume.driver [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=71707) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 24 19:48:16 devstack cinder-volume[71707]: DEBUG oslo_db.sqlalchemy.engines [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71707) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 19:48:16 devstack cinder-volume[71707]: DEBUG dbcounter [-] [71707] Writer thread running {{(pid=71707) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 19:48:16 devstack cinder-volume[71707]: DEBUG cinder.db.sqlalchemy.api [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Building query based on filter {{(pid=71707) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 24 19:48:16 devstack cinder-volume[71707]: DEBUG cinder.image.image_utils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=71707) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 24 19:48:16 devstack cinder-volume[71707]: INFO cinder.keymgr.migration [None req-ae7dfd34-b5dd-416d-b4c2-76e78c76df47 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 24 19:48:16 devstack cinder-volume[71707]: DEBUG cinder.volume.drivers.lvm [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Updating volume stats {{(pid=71707) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 19:48:16 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:16 devstack sudo[72701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 19:48:16 devstack sudo[72701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:17 devstack sudo[72701]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:17 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.495s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:17 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:17 devstack sudo[72705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 19:48:17 devstack sudo[72705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:17 devstack cinder-volume[71594]: DEBUG dbcounter [-] [71594] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=71594) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:48:17 devstack sudo[72705]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:17 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:17 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:17 devstack sudo[72710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 19:48:17 devstack sudo[72710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:18 devstack sudo[72710]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:18 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.526s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:18 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:18 devstack sudo[72717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 19:48:18 devstack sudo[72717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:18 devstack sudo[72717]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:18 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.526s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:18 devstack cinder-volume[71707]: DEBUG cinder.manager [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Notifying Schedulers of capabilities ... {{(pid=71707) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:48:18 devstack cinder-volume[71707]: INFO cinder.volume.manager [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Driver initialization completed successfully.
Apr 24 19:48:18 devstack cinder-volume[71707]: INFO cinder.manager [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Initiating service 2 cleanup
Apr 24 19:48:18 devstack cinder-volume[71707]: INFO cinder.manager [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Service 2 cleanup completed.
Apr 24 19:48:18 devstack cinder-volume[71707]: DEBUG cinder.service [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Creating RPC server for service cinder-volume {{(pid=71707) start /opt/stack/cinder/cinder/service.py:231}}
Apr 24 19:48:18 devstack cinder-volume[71707]: DEBUG cinder.service [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=71707) start /opt/stack/cinder/cinder/service.py:237}}
Apr 24 19:48:18 devstack cinder-volume[71707]: INFO cinder.volume.manager [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 24 19:48:18 devstack cinder-volume[71707]: DEBUG cinder.volume.drivers.lvm [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Updating volume stats {{(pid=71707) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 19:48:18 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:19 devstack sudo[72728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 19:48:19 devstack sudo[72728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:19 devstack sudo[72728]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:19 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.569s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:19 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:19 devstack sudo[72731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 19:48:19 devstack sudo[72731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:20 devstack sudo[72731]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:20 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.507s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:20 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:20 devstack sudo[72777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 19:48:20 devstack sudo[72777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:20 devstack sudo[72777]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:20 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.469s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:20 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:48:20 devstack sudo[73053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 19:48:20 devstack sudo[73053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:48:20 devstack sudo[73053]: pam_unix(sudo:session): session closed for user root
Apr 24 19:48:20 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:48:21 devstack cinder-volume[71707]: INFO cinder.volume.manager [None req-7736d4ed-695a-4fe6-9570-92ccee8c5d8d None None] Driver post RPC initialization completed successfully.
Apr 24 19:48:30 devstack cinder-volume[71707]: DEBUG dbcounter [-] [71707] Writing DB stats cinder:SELECT=5 {{(pid=71707) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:48:30 devstack cinder-volume[71707]: DEBUG dbcounter [-] [71707] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=71707) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:49:11 devstack cinder-volume[71707]: DEBUG oslo_service.periodic_task [None req-642723bc-4489-40f7-832f-51784288527c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71707) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 19:49:11 devstack cinder-volume[71707]: DEBUG cinder.volume.drivers.lvm [None req-642723bc-4489-40f7-832f-51784288527c None None] Updating volume stats {{(pid=71707) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 19:49:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:49:11 devstack sudo[75046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 19:49:11 devstack sudo[75046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:49:11 devstack sudo[75046]: pam_unix(sudo:session): session closed for user root
Apr 24 19:49:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:49:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:49:11 devstack sudo[75049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 19:49:11 devstack sudo[75049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:49:11 devstack sudo[75049]: pam_unix(sudo:session): session closed for user root
Apr 24 19:49:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:49:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:49:11 devstack sudo[75052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 19:49:11 devstack sudo[75052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:49:12 devstack sudo[75052]: pam_unix(sudo:session): session closed for user root
Apr 24 19:49:12 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.508s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:49:12 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:49:12 devstack sudo[75055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 19:49:12 devstack sudo[75055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:49:13 devstack sudo[75055]: pam_unix(sudo:session): session closed for user root
Apr 24 19:49:13 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:49:13 devstack cinder-volume[71707]: DEBUG cinder.manager [None req-642723bc-4489-40f7-832f-51784288527c None None] Notifying Schedulers of capabilities ... {{(pid=71707) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:50:11 devstack cinder-volume[71707]: DEBUG oslo_service.periodic_task [None req-642723bc-4489-40f7-832f-51784288527c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71707) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 19:50:11 devstack cinder-volume[71707]: DEBUG cinder.volume.drivers.lvm [None req-642723bc-4489-40f7-832f-51784288527c None None] Updating volume stats {{(pid=71707) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 19:50:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:50:11 devstack sudo[77838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 19:50:11 devstack sudo[77838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:50:11 devstack sudo[77838]: pam_unix(sudo:session): session closed for user root
Apr 24 19:50:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:50:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:50:11 devstack sudo[77843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 19:50:11 devstack sudo[77843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:50:11 devstack sudo[77843]: pam_unix(sudo:session): session closed for user root
Apr 24 19:50:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:50:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:50:11 devstack sudo[77849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 19:50:11 devstack sudo[77849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:50:12 devstack sudo[77849]: pam_unix(sudo:session): session closed for user root
Apr 24 19:50:12 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:50:12 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:50:12 devstack sudo[77852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 19:50:12 devstack sudo[77852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:50:12 devstack sudo[77852]: pam_unix(sudo:session): session closed for user root
Apr 24 19:50:12 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:50:12 devstack cinder-volume[71707]: DEBUG cinder.manager [None req-642723bc-4489-40f7-832f-51784288527c None None] Notifying Schedulers of capabilities ... {{(pid=71707) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:50:31 devstack cinder-volume[71707]: DEBUG dbcounter [-] [71707] Writing DB stats cinder:SELECT=1 {{(pid=71707) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:50:31 devstack cinder-volume[71707]: DEBUG dbcounter [-] [71707] Writing DB stats cinder:UPDATE=1 {{(pid=71707) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:51:11 devstack cinder-volume[71707]: DEBUG oslo_service.periodic_task [None req-642723bc-4489-40f7-832f-51784288527c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71707) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 19:51:11 devstack cinder-volume[71707]: DEBUG cinder.volume.drivers.lvm [None req-642723bc-4489-40f7-832f-51784288527c None None] Updating volume stats {{(pid=71707) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 19:51:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:51:11 devstack sudo[79902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 19:51:11 devstack sudo[79902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:51:11 devstack sudo[79902]: pam_unix(sudo:session): session closed for user root
Apr 24 19:51:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:51:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:51:11 devstack sudo[79906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 19:51:11 devstack sudo[79906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:51:11 devstack sudo[79906]: pam_unix(sudo:session): session closed for user root
Apr 24 19:51:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:51:11 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:51:11 devstack sudo[79920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 19:51:11 devstack sudo[79920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:51:12 devstack sudo[79920]: pam_unix(sudo:session): session closed for user root
Apr 24 19:51:12 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:51:12 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:51:12 devstack sudo[79923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 19:51:12 devstack sudo[79923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:51:12 devstack sudo[79923]: pam_unix(sudo:session): session closed for user root
Apr 24 19:51:12 devstack cinder-volume[71707]: DEBUG oslo_concurrency.processutils [None req-642723bc-4489-40f7-832f-51784288527c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=71707) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:51:12 devstack cinder-volume[71707]: DEBUG cinder.manager [None req-642723bc-4489-40f7-832f-51784288527c None None] Notifying Schedulers of capabilities ... {{(pid=71707) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:51:45 devstack cinder-volume[71594]: INFO oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Caught SIGTERM, stopping children
Apr 24 19:51:45 devstack cinder-volume[71594]: DEBUG oslo_concurrency.lockutils [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Acquiring lock "singleton_lock" {{(pid=71594) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 19:51:45 devstack cinder-volume[71594]: DEBUG oslo_concurrency.lockutils [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Acquired lock "singleton_lock" {{(pid=71594) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 19:51:45 devstack cinder-volume[71594]: DEBUG oslo_concurrency.lockutils [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Releasing lock "singleton_lock" {{(pid=71594) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 19:51:45 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Stop services. {{(pid=71594) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 24 19:51:45 devstack cinder-volume[71594]: DEBUG oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Killing children. {{(pid=71594) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 24 19:51:45 devstack cinder-volume[71594]: INFO oslo_service.backend._eventlet.service [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Waiting on 1 children to exit
Apr 24 19:51:50 devstack cinder-volume[71707]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Apr 24 19:51:50 devstack cinder-volume[80672]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 24 19:51:50 devstack cinder-volume[80672]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 19:51:50 devstack cinder-volume[80672]: we strongly recommend against using it for new projects.
Apr 24 19:51:50 devstack cinder-volume[80672]: If you are already using Eventlet, we recommend migrating to a different
Apr 24 19:51:50 devstack cinder-volume[80672]: framework.  For more detail see
Apr 24 19:51:50 devstack cinder-volume[80672]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 19:51:50 devstack cinder-volume[80672]:   import eventlet  # noqa
Apr 24 19:51:52 devstack cinder-volume[80672]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 19:51:52 devstack cinder-volume[80672]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 19:51:52 devstack cinder-volume[80672]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 19:51:53 devstack cinder-volume[80672]: INFO dbcounter [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Registered counter for database cinder
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_db.sqlalchemy.engines [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80672) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG dbcounter [-] [80672] Writer thread running {{(pid=80672) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 19:51:53 devstack cinder-volume[80672]: INFO cinder.rpc [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 24 19:51:53 devstack cinder-volume[80672]: INFO cinder.rpc [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_db.sqlalchemy.engines [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80672) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 19:51:53 devstack cinder-volume[80672]: INFO cinder.volume.manager [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Determined volume DB was empty at startup.
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG cinder.volume.manager [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80672) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 24 19:51:53 devstack cinder-volume[80672]: INFO cinder.volume.manager [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 24 19:51:53 devstack cinder-volume[80672]: WARNING stevedore.named [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 24 19:51:53 devstack cinder-volume[80672]: WARNING castellan.key_manager [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 19:51:53 devstack cinder-volume[80672]: WARNING cinder.keymgr.conf_key_mgr [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 19:51:53 devstack cinder-volume[80672]: INFO cinder.volume.manager [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_db.sqlalchemy.engines [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80672) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 19:51:53 devstack cinder-volume[80672]: INFO oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Starting 1 workers
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Started child 80790 {{(pid=80672) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Full set of CONF: {{(pid=80672) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] ******************************************************************************** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Configuration options gathered from: {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] ================================================================================ {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 24 19:51:53 devstack cinder-volume[80790]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] allow_availability_zone_fallback = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] allow_compression_on_image_upload = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] allowed_direct_url_schemes     = [] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] api_rate_limit                 = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] auth_strategy                  = keystone {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_availability_zone      = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_host                   = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_name                   = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_stats_polling_interval = 60 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backup_api_class               = cinder.backup.api.API {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backup_name_template           = backup-%s {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backup_use_same_host           = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backup_use_temp_snapshot       = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] chap_password                  = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] chap_username                  =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cinder_internal_tenant_project_id = 1dd4f42c2f8b48dc8230af20278a8e52 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cinder_internal_tenant_user_id = dc6b72fe2adf4bfb8f3f69518db32112 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cluster                        = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] compression_format             = gzip {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] compute_api_class              = cinder.compute.nova.API {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] config_dir                     = [] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] config_source                  = [] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] control_exchange               = openstack {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] debug                          = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] default_availability_zone      = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] default_group_type             = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] default_volume_type            = QuobyteHD {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] disk_geometry                  = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] driver_client_cert             = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] driver_client_cert_key         = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] driver_data_namespace          = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] driver_ssl_cert_path           = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] driver_ssl_cert_verify         = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] driver_use_ssl                 = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] enable_new_services            = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] enable_unsupported_driver      = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] enabled_backends               = ['QuobyteHD'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] enforce_multipath_for_image_xfer = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] filter_function                = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance_api_insecure            = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance_api_servers             = ['http://192.168.122.91/image'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance_api_ssl_compression     = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance_ca_certificates_file    = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance_catalog_info            = image:glance:publicURL {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance_certfile                = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance_keyfile                 = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance_num_retries             = 3 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance_request_timeout         = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] goodness_function              = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] graceful_shutdown_timeout      = 5 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] group_api_class                = cinder.group.api.API {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] host                           = devstack {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] image_compress_on_upload       = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] image_conversion_address_space_limit = 1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] image_conversion_cpu_limit     = 60 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] image_conversion_disable       = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] image_upload_use_cinder_backend = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] image_upload_use_internal_tenant = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] image_volume_cache_enabled     = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] image_volume_cache_max_count   = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] image_volume_cache_max_size_gb = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] init_host_max_objects_retrieval = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] iscsi_target_flags             =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] iscsi_write_cache              = on {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] iser_helper                    = tgtadm {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] iser_ip_address                = 192.168.122.91 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] iser_port                      = 3260 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] log_color                      = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] log_config_append              = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80790]: INFO cinder.volume.manager [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] log_dir                        = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80790]: DEBUG cinder.volume.drivers.remotefs [None req-22fd50f9-e533-4086-a477-31681674b785 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=80790) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] log_file                       = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] log_options                    = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] log_rotate_interval            = 1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] log_rotate_interval_type       = days {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] log_rotation_type              = none {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] max_age                        = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] max_logfile_count              = 30 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] max_logfile_size_mb            = 200 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] max_over_subscription_ratio    = 20.0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] message_reap_interval          = 86400 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] message_ttl                    = 2592000 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] migration_create_volume_timeout_secs = 300 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] monkey_patch                   = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] monkey_patch_modules           = [] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] my_ip                          = 192.168.122.91 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] no_snapshot_gb_quota           = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] num_iser_scan_tries            = 3 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] num_shell_tries                = 3 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] num_volume_device_scan_tries   = 3 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] nvmeof_conn_info_version       = 1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] nvmet_ns_id                    = 10 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] nvmet_port_id                  = 1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] osapi_max_limit                = 1000 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] osapi_volume_ext_list          = [] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] osapi_volume_listen_port       = 8776 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] osapi_volume_use_ssl           = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] osapi_volume_workers           = 2 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] per_volume_size_limit          = -1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] periodic_fuzzy_delay           = 60 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] periodic_interval              = 60 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] public_endpoint                = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] publish_errors                 = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] quota_backup_gigabytes         = 1000 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] quota_backups                  = 10 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] quota_gigabytes                = 1000 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] quota_groups                   = 10 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] quota_snapshots                = 10 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] quota_volumes                  = 10 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] rate_limit_burst               = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] rate_limit_except_level        = CRITICAL {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] rate_limit_interval            = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] reinit_driver_count            = 3 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] replication_device             = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] report_discard_supported       = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] report_interval                = 120 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] reservation_clean_interval     = 86400 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] reservation_expire             = 86400 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] reserved_image_namespaces      = [] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] reserved_percentage            = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] rpc_response_timeout           = 120 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] run_external_periodic_tasks    = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] scst_target_driver             = iscsi {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] scst_target_iqn_name           = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] service_down_time              = 720 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] shell_completion               = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] snapshot_name_template         = snapshot-%s {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] split_loggers                  = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] state_path                     = /opt/stack/data/cinder {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] storage_availability_zone      = nova {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] storage_protocol               = iSCSI {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] syslog_log_facility            = LOG_USER {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] target_helper                  = lioadm {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] target_ip_address              = 192.168.122.91 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] target_port                    = 3260 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] target_protocol                = iscsi {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] target_secondary_ip_addresses  = [] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] trace_flags                    = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] transport_url                  = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] until_refresh                  = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] use_chap_auth                  = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] use_default_quota_class        = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] use_journal                    = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] use_json                       = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] use_multipath_for_image_xfer   = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] use_stderr                     = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] use_syslog                     = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] verify_glance_signatures       = enabled {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] volume_api_class               = cinder.volume.api.API {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] volume_backend_name            = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] volume_clear                   = zero {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] volume_clear_ionice            = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] volume_clear_size              = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] volume_copy_bps_limit          = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] volume_dd_blocksize            = 1M {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] volume_name_template           = volume-%s {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] volume_service_inithost_offload = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] volume_usage_audit_period      = month {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] zoning_mode                    = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_concurrency.disable_process_locking = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.admin_password = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.admin_token = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.admin_user  = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.auth_port   = 35357 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.auth_protocol = https {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.auth_section = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.auth_type   = password {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.auth_uri    = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.auth_version = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.cache       = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.certfile    = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.identity_uri = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.include_service_catalog = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.insecure    = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.interface   = public {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.keyfile     = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_password =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcache_username =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.region_name = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.service_token_roles_required = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.service_type = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.91/identity {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.backend                  = dogpile.cache.null {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.backend_argument         = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.backend_expiration_time  = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.config_prefix            = cache.oslo {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.debug_cache_backend      = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.enable_retry_client      = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.enable_socket_keepalive  = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.enabled                  = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.enforce_fips_mode        = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.expiration_time          = 600 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.hashclient_retry_attempts = 2 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.memcache_dead_retry      = 300 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.memcache_sasl_enabled    = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.password                 = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.proxies                  = [] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.redis_db                 = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.redis_server             = localhost:6379 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.retry_attempts           = 2 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.retry_delay              = 0.0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.socket_keepalive_count   = 1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.socket_keepalive_idle    = 1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.socket_keepalive_interval = 1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.socket_timeout           = 1.0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.tls_allowed_ciphers      = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.tls_cafile               = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.tls_certfile             = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.tls_enabled              = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.tls_keyfile              = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cache.username                 = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] coordination.backend_url       = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.asyncio_connection    = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.asyncio_slave_connection = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.backend               = sqlalchemy {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.connection            = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.connection_debug      = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.connection_parameters =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.connection_recycle_time = 3600 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.connection_trace      = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.db_inc_retry_interval = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.db_max_retries        = 20 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.db_max_retry_interval = 10 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.db_retry_interval     = 1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.max_overflow          = 50 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.max_pool_size         = 5 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.max_retries           = 10 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.mysql_wsrep_sync_wait = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.pool_timeout          = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.retry_interval        = 10 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.slave_connection      = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.sqlite_synchronous    = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80790]: DEBUG cinder.volume.drivers.quobyte [None req-22fd50f9-e533-4086-a477-31681674b785 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=80790) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.synchronous_reader    = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80790]: WARNING cinder.volume.drivers.quobyte [None req-22fd50f9-e533-4086-a477-31681674b785 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 24 19:51:53 devstack cinder-volume[80790]: WARNING cinder.volume.drivers.quobyte [None req-22fd50f9-e533-4086-a477-31681674b785 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] database.use_db_reconnect      = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] profiler.connection_string     = messaging:// {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] profiler.enabled               = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] profiler.es_doc_type           = notification {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] profiler.es_scroll_size        = 10000 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] profiler.es_scroll_time        = 2m {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] profiler.filter_error_trace    = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] profiler.hmac_keys             = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] profiler.sentinel_service_name = mymaster {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] profiler.socket_timeout        = 0.1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] profiler.trace_requests        = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] profiler.trace_sqlalchemy      = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] profiler_jaeger.process_tags   = {} {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] profiler_jaeger.service_name_prefix = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] profiler_otlp.service_name_prefix = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_policy.enforce_new_defaults = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: WARNING oslo_config.cfg [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_policy.enforce_scope      = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_policy.policy_default_rule = default {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] privsep_osbrick.group          = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80790]: DEBUG oslo_concurrency.processutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Running cmd (subprocess): mount.quobyte {{(pid=80790) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] privsep_osbrick.helper_command = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] privsep_osbrick.user           = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cinder_sys_admin.group         = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cinder_sys_admin.helper_command = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] cinder_sys_admin.user          = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] service_user.auth_section      = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] service_user.auth_type         = password {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] service_user.cafile            = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] service_user.certfile          = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] service_user.collect_timing    = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] service_user.insecure          = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] service_user.keyfile           = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] service_user.send_service_user_token = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] service_user.split_loggers     = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] service_user.timeout           = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance.auth_section            = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance.auth_type               = password {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance.certfile                = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance.collect_timing          = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance.insecure                = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance.keyfile                 = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance.region_name             = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance.split_loggers           = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] glance.timeout                 = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.backend_availability_zone = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.chap_password = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.chap_username =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.disk_geometry = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.driver_client_cert = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.driver_client_cert_key = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.driver_data_namespace = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.driver_use_ssl = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.extra_capabilities = {} {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.filter_function = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.goodness_function = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.iscsi_target_flags =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.iscsi_write_cache = on {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.iser_helper   = tgtadm {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.iser_ip_address = 192.168.122.91 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.iser_port     = 3260 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.nas_host      =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.nas_login     = admin {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.nas_mount_options = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.nas_password  = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.nas_private_key =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.nas_share_path =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.num_shell_tries = 3 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.quobyte_volume_url = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.replication_device = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.report_discard_supported = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.reserved_percentage = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.target_helper = tgtadm {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.target_ip_address = 192.168.122.91 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.target_port   = 3260 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.target_protocol = iscsi {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.trace_flags   = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.unique_fqdn_network = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.use_chap_auth = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.volume_backend_name = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.volume_clear  = zero {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.volume_clear_ionice = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.volume_clear_size = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_reports.file_event_handler = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_reports.log_dir           = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.backend_availability_zone = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.backend_host         = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.chap_password        = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.chap_username        = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.chiscsi_conf         = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.disk_geometry        = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.driver_client_cert   = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.driver_data_namespace = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.driver_use_ssl       = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.extra_capabilities   = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.filter_function      = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.goodness_function    = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.iser_helper          = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.iser_ip_address      = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.iser_port            = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.iser_target_prefix   = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.nas_host             = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.nas_login            = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.nas_mount_options    = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.nas_password         = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.nas_private_key      = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.nas_share_path       = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.nas_ssh_port         = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.num_shell_tries      = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.nvmet_port_id        = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.replication_device   = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.report_discard_supported = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.reserved_percentage  = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.scst_target_driver   = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.storage_protocol     = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.target_helper        = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.target_ip_address    = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.target_port          = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.target_prefix        = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.target_protocol      = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.trace_flags          = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.use_chap_auth        = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.volume_clear         = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.volume_clear_size    = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] QuobyteHD.volumes_dir          = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_notifications.driver = [] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_notifications.retry = -1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] key_manager.fixed_key          = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.barbican_api_version  = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.barbican_endpoint     = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.barbican_endpoint_type = public {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.barbican_region_name  = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80790]: DEBUG oslo_concurrency.processutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] CMD "mount.quobyte" returned: 1 in 0.088s {{(pid=80790) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.cafile                = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80790) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.certfile              = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80790) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:51:53 devstack cinder-volume[80790]: DEBUG cinder.volume.drivers.quobyte [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=80790) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.collect_timing        = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.insecure              = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.keyfile               = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80790]: INFO cinder.volume.drivers.quobyte [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e ...
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.number_of_retries     = 60 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.retry_delay           = 1 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80790]: DEBUG oslo_concurrency.processutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 -c /etc/quobyte/client-cinder.cfg {{(pid=80790) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.send_service_user_token = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.split_loggers         = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.timeout               = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.verify_ssl            = True {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican.verify_ssl_path       = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican_service_user.auth_section = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican_service_user.auth_type = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican_service_user.cafile   = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican_service_user.certfile = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican_service_user.collect_timing = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican_service_user.insecure = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican_service_user.keyfile  = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican_service_user.split_loggers = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] barbican_service_user.timeout  = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] vault.approle_role_id          = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] vault.approle_secret_id        = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] vault.kv_mountpoint            = secret {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] vault.kv_path                  = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] vault.kv_version               = 2 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] vault.namespace                = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] vault.root_token_id            = **** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] vault.ssl_ca_crt_file          = None {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] vault.timeout                  = 60.0 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] vault.use_ssl                  = False {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:51:53 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] ******************************************************************************** {{(pid=80672) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 24 19:51:53 devstack sudo[80792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 -c /etc/quobyte/client-cinder.cfg
Apr 24 19:51:53 devstack sudo[80792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:51:53 devstack cinder-volume[71707]: DEBUG oslo_concurrency.lockutils [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Acquiring lock "singleton_lock" {{(pid=71707) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 19:51:53 devstack cinder-volume[71707]: DEBUG oslo_concurrency.lockutils [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Acquired lock "singleton_lock" {{(pid=71707) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 19:51:53 devstack cinder-volume[71707]: DEBUG oslo_concurrency.lockutils [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Releasing lock "singleton_lock" {{(pid=71707) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 19:51:53 devstack cinder-volume[71707]: WARNING amqp [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 24 19:51:53 devstack cinder-volume[71707]: WARNING amqp [None req-2524f5e7-142e-414a-860c-af5dac310f02 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 24 19:51:54 devstack sudo[80792]: pam_unix(sudo:session): session closed for user root
Apr 24 19:51:54 devstack cinder-volume[80790]: DEBUG oslo_concurrency.processutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.746s {{(pid=80790) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:51:54 devstack cinder-volume[80790]: INFO cinder.volume.drivers.quobyte [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e succeeded
Apr 24 19:51:54 devstack cinder-volume[80790]: DEBUG cinder.volume.drivers.quobyte [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=80790) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:51:54 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.755s {{(pid=80790) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:51:54 devstack cinder-volume[80790]: DEBUG oslo_concurrency.processutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=80790) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:51:54 devstack sudo[80861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:51:54 devstack sudo[80861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:51:55 devstack sudo[80861]: pam_unix(sudo:session): session closed for user root
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG oslo_concurrency.processutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.398s {{(pid=80790) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:51:55 devstack cinder-volume[80790]: INFO cinder.volume.driver [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Driver hasn't implemented _init_vendor_properties()
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG cinder.volume.driver [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309837341309, 'free_capacity_gb': 1775.7309837341309, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80790) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG oslo_db.sqlalchemy.engines [None req-22fd50f9-e533-4086-a477-31681674b785 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80790) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG dbcounter [-] [80790] Writer thread running {{(pid=80790) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG cinder.db.sqlalchemy.api [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Building query based on filter {{(pid=80790) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG cinder.image.image_utils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=80790) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 24 19:51:55 devstack cinder-volume[80790]: INFO cinder.keymgr.migration [None req-b2300b31-ca30-4a08-bee1-50a49b89d109 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80790) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80790) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG cinder.volume.drivers.quobyte [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=80790) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG cinder.volume.drivers.quobyte [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=80790) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80790) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG oslo_concurrency.processutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=80790) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:51:55 devstack sudo[80864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:51:55 devstack sudo[80864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:51:55 devstack sudo[80864]: pam_unix(sudo:session): session closed for user root
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG oslo_concurrency.processutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.449s {{(pid=80790) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG cinder.manager [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Notifying Schedulers of capabilities ... {{(pid=80790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:51:55 devstack cinder-volume[80790]: INFO cinder.volume.manager [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Driver initialization completed successfully.
Apr 24 19:51:55 devstack cinder-volume[80790]: INFO cinder.manager [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Initiating service 3 cleanup
Apr 24 19:51:55 devstack cinder-volume[80790]: INFO cinder.manager [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Service 3 cleanup completed.
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG cinder.service [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Creating RPC server for service cinder-volume {{(pid=80790) start /opt/stack/cinder/cinder/service.py:231}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG cinder.service [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=80790) start /opt/stack/cinder/cinder/service.py:237}}
Apr 24 19:51:55 devstack cinder-volume[80790]: INFO cinder.volume.manager [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80790) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80790) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG cinder.volume.drivers.quobyte [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=80790) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG cinder.volume.drivers.quobyte [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=80790) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80790) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:51:55 devstack cinder-volume[80790]: DEBUG oslo_concurrency.processutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=80790) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:51:55 devstack sudo[80871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:51:55 devstack sudo[80871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:51:56 devstack sudo[80871]: pam_unix(sudo:session): session closed for user root
Apr 24 19:51:56 devstack cinder-volume[80790]: DEBUG oslo_concurrency.processutils [None req-22fd50f9-e533-4086-a477-31681674b785 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.494s {{(pid=80790) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:51:56 devstack cinder-volume[80790]: INFO cinder.volume.manager [None req-22fd50f9-e533-4086-a477-31681674b785 None None] Driver post RPC initialization completed successfully.
Apr 24 19:51:59 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-800c608f-707c-49da-b4ec-6f086b30d1be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80790) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:51:59 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-800c608f-707c-49da-b4ec-6f086b30d1be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80790) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:51:59 devstack cinder-volume[80790]: DEBUG cinder.volume.drivers.quobyte [None req-800c608f-707c-49da-b4ec-6f086b30d1be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=80790) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:51:59 devstack cinder-volume[80790]: DEBUG cinder.volume.drivers.quobyte [None req-800c608f-707c-49da-b4ec-6f086b30d1be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=80790) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:51:59 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-800c608f-707c-49da-b4ec-6f086b30d1be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80790) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:51:59 devstack cinder-volume[80790]: DEBUG oslo_concurrency.processutils [None req-800c608f-707c-49da-b4ec-6f086b30d1be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=80790) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:51:59 devstack sudo[80977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:51:59 devstack sudo[80977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:51:59 devstack sudo[80977]: pam_unix(sudo:session): session closed for user root
Apr 24 19:51:59 devstack cinder-volume[80790]: DEBUG oslo_concurrency.processutils [None req-800c608f-707c-49da-b4ec-6f086b30d1be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.485s {{(pid=80790) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:51:59 devstack cinder-volume[80790]: DEBUG cinder.manager [None req-800c608f-707c-49da-b4ec-6f086b30d1be None None] Notifying Schedulers of capabilities ... {{(pid=80790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:52:01 devstack cinder-volume[80672]: INFO oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Caught SIGTERM, stopping children
Apr 24 19:52:01 devstack cinder-volume[80672]: DEBUG oslo_concurrency.lockutils [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Acquiring lock "singleton_lock" {{(pid=80672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 19:52:01 devstack cinder-volume[80672]: DEBUG oslo_concurrency.lockutils [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Acquired lock "singleton_lock" {{(pid=80672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 19:52:01 devstack cinder-volume[80672]: DEBUG oslo_concurrency.lockutils [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Releasing lock "singleton_lock" {{(pid=80672) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 19:52:01 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Stop services. {{(pid=80672) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 24 19:52:01 devstack cinder-volume[80672]: DEBUG oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Killing children. {{(pid=80672) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 24 19:52:01 devstack cinder-volume[80672]: INFO oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Waiting on 1 children to exit
Apr 24 19:52:03 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Acquiring lock "singleton_lock" {{(pid=80790) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 19:52:03 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Acquired lock "singleton_lock" {{(pid=80790) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 19:52:03 devstack cinder-volume[80790]: DEBUG oslo_concurrency.lockutils [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Releasing lock "singleton_lock" {{(pid=80790) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 19:52:04 devstack cinder-volume[80790]: WARNING amqp [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 24 19:52:04 devstack cinder-volume[80790]: WARNING amqp [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 24 19:52:04 devstack cinder-volume[80672]: INFO oslo_service.backend._eventlet.service [None req-0ca745ef-7cb1-4a5a-802a-dc42d20ddfb8 None None] Child 80790 exited with status 0
Apr 24 19:52:04 devstack cinder-volume[81064]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 24 19:52:04 devstack cinder-volume[81064]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 19:52:04 devstack cinder-volume[81064]: we strongly recommend against using it for new projects.
Apr 24 19:52:04 devstack cinder-volume[81064]: If you are already using Eventlet, we recommend migrating to a different
Apr 24 19:52:04 devstack cinder-volume[81064]: framework.  For more detail see
Apr 24 19:52:04 devstack cinder-volume[81064]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 19:52:04 devstack cinder-volume[81064]:   import eventlet  # noqa
Apr 24 19:52:06 devstack cinder-volume[81064]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81064) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 19:52:06 devstack cinder-volume[81064]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81064) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 19:52:06 devstack cinder-volume[81064]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81064) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 19:52:06 devstack cinder-volume[81064]: INFO dbcounter [None req-aca1556b-2b43-4186-8d36-e987290967af None None] Registered counter for database cinder
Apr 24 19:52:06 devstack cinder-volume[81064]: DEBUG oslo_db.sqlalchemy.engines [None req-aca1556b-2b43-4186-8d36-e987290967af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG dbcounter [-] [81064] Writer thread running {{(pid=81064) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 19:52:07 devstack cinder-volume[81064]: INFO cinder.rpc [None req-aca1556b-2b43-4186-8d36-e987290967af None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 24 19:52:07 devstack cinder-volume[81064]: INFO cinder.rpc [None req-aca1556b-2b43-4186-8d36-e987290967af None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_db.sqlalchemy.engines [None req-aca1556b-2b43-4186-8d36-e987290967af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 19:52:07 devstack cinder-volume[81064]: INFO cinder.volume.manager [None req-aca1556b-2b43-4186-8d36-e987290967af None None] Determined volume DB was empty at startup.
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG cinder.volume.manager [None req-aca1556b-2b43-4186-8d36-e987290967af None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81064) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 24 19:52:07 devstack cinder-volume[81064]: WARNING stevedore.named [None req-aca1556b-2b43-4186-8d36-e987290967af None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 24 19:52:07 devstack cinder-volume[81064]: WARNING castellan.key_manager [None req-aca1556b-2b43-4186-8d36-e987290967af None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 19:52:07 devstack cinder-volume[81064]: WARNING cinder.keymgr.conf_key_mgr [None req-aca1556b-2b43-4186-8d36-e987290967af None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 19:52:07 devstack cinder-volume[81064]: INFO cinder.volume.manager [None req-aca1556b-2b43-4186-8d36-e987290967af None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_db.sqlalchemy.engines [None req-aca1556b-2b43-4186-8d36-e987290967af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 19:52:07 devstack cinder-volume[81064]: INFO oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] Starting 1 workers
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] Started child 81241 {{(pid=81064) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] Full set of CONF: {{(pid=81064) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] ******************************************************************************** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] Configuration options gathered from: {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] ================================================================================ {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] allow_availability_zone_fallback = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] allow_compression_on_image_upload = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] allowed_direct_url_schemes     = [] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] api_rate_limit                 = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] auth_strategy                  = keystone {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_availability_zone      = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_host                   = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_name                   = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_stats_polling_interval = 60 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backup_api_class               = cinder.backup.api.API {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backup_name_template           = backup-%s {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backup_use_same_host           = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backup_use_temp_snapshot       = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] chap_password                  = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] chap_username                  =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cinder_internal_tenant_project_id = 1dd4f42c2f8b48dc8230af20278a8e52 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cinder_internal_tenant_user_id = dc6b72fe2adf4bfb8f3f69518db32112 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cluster                        = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] compression_format             = gzip {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] compute_api_class              = cinder.compute.nova.API {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81241]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] config_dir                     = [] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] config_source                  = [] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] control_exchange               = openstack {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] debug                          = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] default_availability_zone      = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] default_group_type             = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] default_volume_type            = QuobyteHD {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] disk_geometry                  = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] driver_client_cert             = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] driver_client_cert_key         = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] driver_data_namespace          = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] driver_ssl_cert_path           = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] driver_ssl_cert_verify         = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] driver_use_ssl                 = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] enable_new_services            = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] enable_unsupported_driver      = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] enabled_backends               = ['QuobyteHD'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] enforce_multipath_for_image_xfer = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] filter_function                = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance_api_insecure            = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance_api_servers             = ['http://192.168.122.91/image'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance_api_ssl_compression     = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance_ca_certificates_file    = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance_catalog_info            = image:glance:publicURL {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance_certfile                = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance_keyfile                 = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance_num_retries             = 3 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance_request_timeout         = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] goodness_function              = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] graceful_shutdown_timeout      = 5 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] group_api_class                = cinder.group.api.API {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] host                           = devstack {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] image_compress_on_upload       = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] image_conversion_address_space_limit = 1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] image_conversion_cpu_limit     = 60 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] image_conversion_disable       = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] image_upload_use_cinder_backend = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] image_upload_use_internal_tenant = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] image_volume_cache_enabled     = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] image_volume_cache_max_count   = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] image_volume_cache_max_size_gb = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] init_host_max_objects_retrieval = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] instance_format                = [instance: %(uuid)s]  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] iscsi_target_flags             =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] iscsi_write_cache              = on {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] iser_helper                    = tgtadm {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] iser_ip_address                = 192.168.122.91 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] iser_port                      = 3260 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] log_color                      = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] log_config_append              = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] log_dir                        = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] log_file                       = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] log_options                    = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] log_rotate_interval            = 1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] log_rotate_interval_type       = days {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] log_rotation_type              = none {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] max_age                        = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] max_logfile_count              = 30 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] max_logfile_size_mb            = 200 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] max_over_subscription_ratio    = 20.0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] message_reap_interval          = 86400 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] message_ttl                    = 2592000 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] migration_create_volume_timeout_secs = 300 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] monkey_patch                   = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] monkey_patch_modules           = [] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] my_ip                          = 192.168.122.91 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] no_snapshot_gb_quota           = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] num_iser_scan_tries            = 3 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] num_shell_tries                = 3 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] num_volume_device_scan_tries   = 3 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] nvmeof_conn_info_version       = 1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] nvmet_ns_id                    = 10 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] nvmet_port_id                  = 1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] osapi_max_limit                = 1000 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] osapi_volume_ext_list          = [] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] osapi_volume_listen_port       = 8776 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] osapi_volume_use_ssl           = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] osapi_volume_workers           = 2 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] per_volume_size_limit          = -1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] periodic_fuzzy_delay           = 60 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] periodic_interval              = 60 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] public_endpoint                = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] publish_errors                 = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] quota_backup_gigabytes         = 1000 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] quota_backups                  = 10 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] quota_gigabytes                = 1000 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] quota_groups                   = 10 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] quota_snapshots                = 10 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] quota_volumes                  = 10 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] rate_limit_burst               = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] rate_limit_except_level        = CRITICAL {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] rate_limit_interval            = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] reinit_driver_count            = 3 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] replication_device             = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] report_discard_supported       = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] report_interval                = 120 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] reservation_clean_interval     = 86400 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] reservation_expire             = 86400 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] reserved_image_namespaces      = [] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] reserved_percentage            = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] rpc_response_timeout           = 120 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] run_external_periodic_tasks    = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] scst_target_driver             = iscsi {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] scst_target_iqn_name           = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] service_down_time              = 720 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] shell_completion               = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] snapshot_name_template         = snapshot-%s {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] split_loggers                  = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] state_path                     = /opt/stack/data/cinder {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] storage_availability_zone      = nova {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] storage_protocol               = iSCSI {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] syslog_log_facility            = LOG_USER {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] target_helper                  = lioadm {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] target_ip_address              = 192.168.122.91 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] target_port                    = 3260 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] target_protocol                = iscsi {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] target_secondary_ip_addresses  = [] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] trace_flags                    = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] transport_url                  = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] until_refresh                  = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] use_chap_auth                  = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] use_default_quota_class        = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] use_journal                    = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] use_json                       = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] use_multipath_for_image_xfer   = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] use_stderr                     = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] use_syslog                     = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] verify_glance_signatures       = enabled {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] volume_api_class               = cinder.volume.api.API {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] volume_backend_name            = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] volume_clear                   = zero {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] volume_clear_ionice            = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] volume_clear_size              = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] volume_copy_bps_limit          = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] volume_dd_blocksize            = 1M {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] volume_name_template           = volume-%s {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] volume_service_inithost_offload = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] volume_usage_audit_period      = month {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] zoning_mode                    = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81241) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_concurrency.disable_process_locking = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.admin_password = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.admin_token = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.admin_user  = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.auth_port   = 35357 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.auth_protocol = https {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.auth_section = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.auth_type   = password {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.auth_uri    = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.auth_version = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.cache       = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.certfile    = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.delay_auth_decision = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.http_connect_timeout = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.identity_uri = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.include_service_catalog = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.insecure    = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.interface   = public {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.keyfile     = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_password =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcache_username =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.region_name = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.service_token_roles_required = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.service_type = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.token_cache_time = 300 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.91/identity {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.backend                  = dogpile.cache.null {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.backend_argument         = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.backend_expiration_time  = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.config_prefix            = cache.oslo {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.debug_cache_backend      = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.enable_retry_client      = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.enable_socket_keepalive  = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.enabled                  = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.enforce_fips_mode        = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.expiration_time          = 600 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.hashclient_retry_attempts = 2 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.memcache_dead_retry      = 300 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.memcache_pool_maxsize    = 10 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.memcache_sasl_enabled    = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.password                 = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.proxies                  = [] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.redis_db                 = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.redis_sentinel_service_name = mymaster {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.redis_server             = localhost:6379 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.retry_attempts           = 2 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.retry_delay              = 0.0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.socket_keepalive_count   = 1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.socket_keepalive_idle    = 1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.socket_keepalive_interval = 1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.socket_timeout           = 1.0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.tls_allowed_ciphers      = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.tls_cafile               = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.tls_certfile             = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.tls_enabled              = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.tls_keyfile              = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cache.username                 = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] coordination.backend_url       = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.asyncio_connection    = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.asyncio_slave_connection = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.backend               = sqlalchemy {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.connection            = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.connection_debug      = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.connection_parameters =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.connection_recycle_time = 3600 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.connection_trace      = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.db_inc_retry_interval = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.db_max_retries        = 20 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.db_max_retry_interval = 10 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.db_retry_interval     = 1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.max_overflow          = 50 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.max_pool_size         = 5 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.max_retries           = 10 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.mysql_wsrep_sync_wait = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.pool_timeout          = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.retry_interval        = 10 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.slave_connection      = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.sqlite_synchronous    = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.synchronous_reader    = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] database.use_db_reconnect      = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] profiler.connection_string     = messaging:// {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] profiler.enabled               = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] profiler.es_doc_type           = notification {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] profiler.es_scroll_size        = 10000 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] profiler.es_scroll_time        = 2m {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] profiler.filter_error_trace    = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] profiler.hmac_keys             = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] profiler.sentinel_service_name = mymaster {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] profiler.socket_timeout        = 0.1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] profiler.trace_requests        = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] profiler.trace_sqlalchemy      = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] profiler_jaeger.process_tags   = {} {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] profiler_jaeger.service_name_prefix = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] profiler_otlp.service_name_prefix = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_policy.enforce_new_defaults = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: WARNING oslo_config.cfg [None req-aca1556b-2b43-4186-8d36-e987290967af None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_policy.enforce_scope      = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_policy.policy_default_rule = default {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_policy.policy_file        = policy.yaml {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] privsep_osbrick.group          = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] privsep_osbrick.helper_command = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] privsep_osbrick.user           = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81241) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 24 19:52:07 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.quobyte [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 24 19:52:07 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.quobyte [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cinder_sys_admin.group         = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cinder_sys_admin.helper_command = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Running cmd (subprocess): mount.quobyte {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] cinder_sys_admin.user          = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] service_user.auth_section      = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] service_user.auth_type         = password {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] service_user.cafile            = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] service_user.certfile          = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] service_user.collect_timing    = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] service_user.insecure          = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] service_user.keyfile           = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] service_user.send_service_user_token = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] service_user.split_loggers     = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] service_user.timeout           = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance.auth_section            = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance.auth_type               = password {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance.certfile                = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance.collect_timing          = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance.insecure                = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance.keyfile                 = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance.region_name             = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance.split_loggers           = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] glance.timeout                 = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.backend_availability_zone = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.chap_password = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.chap_username =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.disk_geometry = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.driver_client_cert = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.driver_client_cert_key = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.driver_data_namespace = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.driver_use_ssl = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.enable_unsupported_driver = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.extra_capabilities = {} {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.filter_function = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.goodness_function = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.iscsi_target_flags =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.iscsi_write_cache = on {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.iser_helper   = tgtadm {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.iser_ip_address = 192.168.122.91 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.iser_port     = 3260 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.nas_host      =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.nas_login     = admin {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.nas_mount_options = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.nas_password  = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.nas_private_key =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.nas_share_path =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.num_shell_tries = 3 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.nvmet_port_id = 1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.quobyte_client_cfg = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.quobyte_volume_url = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.replication_device = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.report_discard_supported = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.reserved_percentage = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.scst_target_driver = iscsi {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.scst_target_iqn_name = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.storage_protocol = iSCSI {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.target_helper = tgtadm {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.target_ip_address = 192.168.122.91 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.target_port   = 3260 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.target_protocol = iscsi {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.trace_flags   = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.unique_fqdn_network = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.use_chap_auth = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.volume_backend_name = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.volume_clear  = zero {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.volume_clear_ionice = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.volume_clear_size = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_reports.file_event_handler = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_reports.log_dir           = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.backend_availability_zone = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.backend_host         = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.chap_password        = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.chap_username        = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.chiscsi_conf         = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.disk_geometry        = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.driver_client_cert   = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.driver_client_cert_key = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.driver_data_namespace = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.driver_use_ssl       = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.extra_capabilities   = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.filter_function      = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.goodness_function    = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.iser_helper          = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.iser_ip_address      = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.iser_port            = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.iser_target_prefix   = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.nas_host             = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.nas_login            = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.nas_mount_options    = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.nas_password         = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.nas_private_key      = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.nas_share_path       = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.nas_ssh_port         = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.num_shell_tries      = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.nvmet_port_id        = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.replication_device   = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.report_discard_supported = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.reserved_percentage  = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.scst_target_driver   = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.storage_protocol     = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.target_helper        = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.target_ip_address    = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.target_port          = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.target_prefix        = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.target_protocol      = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.trace_flags          = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.use_chap_auth        = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.volume_clear         = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.volume_clear_size    = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] QuobyteHD.volumes_dir          = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack quobyte-client[81245]: Reading configuration file: /etc/quobyte/client.cfg
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack quobyte-client[81245]: Invalid parameters found, error: missing mount point.
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack quobyte-client[81245]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack quobyte-client[81245]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.ssl      = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_notifications.driver = [] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_notifications.retry = -1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] oslo_messaging_notifications.transport_url = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] key_manager.fixed_key          = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.barbican_api_version  = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.barbican_endpoint     = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.barbican_endpoint_type = public {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.barbican_region_name  = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.cafile                = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.certfile              = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.collect_timing        = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.insecure              = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.keyfile               = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.number_of_retries     = 60 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.retry_delay           = 1 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.send_service_user_token = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.split_loggers         = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.timeout               = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.verify_ssl            = True {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican.verify_ssl_path       = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican_service_user.auth_section = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican_service_user.auth_type = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican_service_user.cafile   = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican_service_user.certfile = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican_service_user.collect_timing = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican_service_user.insecure = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican_service_user.keyfile  = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican_service_user.split_loggers = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] barbican_service_user.timeout  = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] vault.approle_role_id          = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] vault.approle_secret_id        = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] vault.kv_mountpoint            = secret {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] vault.kv_path                  = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] vault.kv_version               = 2 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] vault.namespace                = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] vault.root_token_id            = **** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] vault.ssl_ca_crt_file          = None {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] vault.timeout                  = 60.0 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] vault.use_ssl                  = False {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 19:52:07 devstack cinder-volume[81064]: DEBUG oslo_service.backend._eventlet.service [None req-aca1556b-2b43-4186-8d36-e987290967af None None] ******************************************************************************** {{(pid=81064) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:52:07 devstack sudo[81255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:52:07 devstack sudo[81255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:52:07 devstack sudo[81255]: pam_unix(sudo:session): session closed for user root
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.412s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:52:07 devstack cinder-volume[81241]: INFO cinder.volume.driver [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Driver hasn't implemented _init_vendor_properties()
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG cinder.volume.driver [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309837341309, 'free_capacity_gb': 1775.7309837341309, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81241) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG oslo_db.sqlalchemy.engines [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81241) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writer thread running {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG cinder.db.sqlalchemy.api [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Building query based on filter {{(pid=81241) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81241) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:52:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:52:07 devstack cinder-volume[81241]: INFO cinder.keymgr.migration [None req-7aab6da0-b22a-4935-b87e-8945bc3b2365 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 24 19:52:07 devstack sudo[81287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:52:07 devstack sudo[81287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:52:08 devstack sudo[81287]: pam_unix(sudo:session): session closed for user root
Apr 24 19:52:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.420s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:52:08 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:52:08 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Driver initialization completed successfully.
Apr 24 19:52:08 devstack cinder-volume[81241]: INFO cinder.manager [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Initiating service 3 cleanup
Apr 24 19:52:08 devstack cinder-volume[81241]: INFO cinder.manager [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Service 3 cleanup completed.
Apr 24 19:52:08 devstack cinder-volume[81241]: DEBUG cinder.service [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Creating RPC server for service cinder-volume {{(pid=81241) start /opt/stack/cinder/cinder/service.py:231}}
Apr 24 19:52:08 devstack cinder-volume[81241]: DEBUG cinder.service [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81241) start /opt/stack/cinder/cinder/service.py:237}}
Apr 24 19:52:08 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 24 19:52:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:52:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:52:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:52:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:52:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:52:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:52:08 devstack sudo[81301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:52:08 devstack sudo[81301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:52:08 devstack sudo[81301]: pam_unix(sudo:session): session closed for user root
Apr 24 19:52:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.423s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:52:08 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-1c49e05e-4199-4fbb-8912-6129d6e0cd58 None None] Driver post RPC initialization completed successfully.
Apr 24 19:52:17 devstack cinder-volume[81064]: DEBUG dbcounter [-] [81064] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81064) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:52:18 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=2 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:52:18 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:52:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-99586444-a460-4c81-8609-2c18940a56da tempest-BackendsCapabilitiesAdminTestsJSON-144753367 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309837341309, 'free_capacity_gb': 1775.7309837341309, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81241) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 24 19:52:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0248af08-046e-4ec0-be4d-2d5df808cde2 tempest-BackendsCapabilitiesAdminTestsJSON-144753367 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309837341309, 'free_capacity_gb': 1775.7309837341309, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81241) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Flow 'volume_create_manager' (e9cbb0a2-0019-4262-9fdc-14caadf60136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d784c4-9183-4626-a36b-94ca8ea13a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d784c4-9183-4626-a36b-94ca8ea13a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1623680221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0dfbc0-543c-4a57-b95d-bcf05d23f84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1378922c6904d2e9f4ce8783ba91c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:06Z,use_quota=True,user_id='d7d92bc6c7974904adf0a9f9b860b225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44eec92-b6bb-4de4-9bbd-73214537326a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44eec92-b6bb-4de4-9bbd-73214537326a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b9254f-a8ea-4190-a31c-ecce83f1cb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b9254f-a8ea-4190-a31c-ecce83f1cb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0dfbc0-543c-4a57-b95d-bcf05d23f84e', 'volume_name': 'volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fba5b0b-0dfc-4604-b0af-08667a93f667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fba5b0b-0dfc-4604-b0af-08667a93f667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e62848-6074-48ca-9cbe-4231eaa9269d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:06 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Volume ea0dfbc0-543c-4a57-b95d-bcf05d23f84e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e', 'volume_size': 1}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1623680221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0dfbc0-543c-4a57-b95d-bcf05d23f84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1378922c6904d2e9f4ce8783ba91c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:06Z,use_quota=True,user_id='d7d92bc6c7974904adf0a9f9b860b225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Creating volume ea0dfbc0-543c-4a57-b95d-bcf05d23f84e {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:53:06 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:06 devstack sudo[81656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e 1073741824
Apr 24 19:53:06 devstack sudo[81656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Flow 'volume_create_manager' (7f520637-8126-44d8-bf87-d06971334a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72f1c01-89f2-4ac2-93a0-1a51b32a2f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72f1c01-89f2-4ac2-93a0-1a51b32a2f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-397089096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef06be83-b61f-473c-9a55-ab95ab7d34d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236e1c10db284972ab989403d9fc0a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:07Z,use_quota=True,user_id='86fb8912541148aebea7e828dc281272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32a842e-9432-4b7b-a165-b43042388ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32a842e-9432-4b7b-a165-b43042388ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749ce4a6-e0e2-4673-a5b2-1ed0940fa3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749ce4a6-e0e2-4673-a5b2-1ed0940fa3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef06be83-b61f-473c-9a55-ab95ab7d34d5', 'volume_name': 'volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b36ae7-3aaa-4a8e-af02-160ae06604de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b36ae7-3aaa-4a8e-af02-160ae06604de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080cc462-51de-4c83-8bf7-e014583af40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:06 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Volume ef06be83-b61f-473c-9a55-ab95ab7d34d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5', 'volume_size': 1}
Apr 24 19:53:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:07 devstack sudo[81656]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e 1073741824" returned: 0 in 1.070s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:07 devstack sudo[81979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e
Apr 24 19:53:07 devstack sudo[81979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:08 devstack sudo[81979]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e" returned: 0 in 0.734s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.353s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-397089096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef06be83-b61f-473c-9a55-ab95ab7d34d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236e1c10db284972ab989403d9fc0a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:07Z,use_quota=True,user_id='86fb8912541148aebea7e828dc281272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Creating volume ef06be83-b61f-473c-9a55-ab95ab7d34d5 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:53:08 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e62848-6074-48ca-9cbe-4231eaa9269d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4985883e-f779-4bbc-9eec-9664159f932e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:08 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Volume volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e (ea0dfbc0-543c-4a57-b95d-bcf05d23f84e): created successfully
Apr 24 19:53:08 devstack sudo[81984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5 1073741824
Apr 24 19:53:08 devstack sudo[81984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4985883e-f779-4bbc-9eec-9664159f932e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Flow 'volume_create_manager' (e9cbb0a2-0019-4262-9fdc-14caadf60136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:53:08 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f2bd98d7-2d3b-45ee-91ef-ecc0717ad8e9 tempest-DeleteServersTestJSON-1599888503 None] Created volume successfully.
Apr 24 19:53:09 devstack sudo[81984]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5 1073741824" returned: 0 in 1.036s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:09 devstack sudo[82006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5
Apr 24 19:53:09 devstack sudo[82006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:10 devstack sudo[82006]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5" returned: 0 in 0.813s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:10 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:53:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080cc462-51de-4c83-8bf7-e014583af40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a6d1ab-2a8c-484f-9d79-9599a2d1bcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:10 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Volume volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5 (ef06be83-b61f-473c-9a55-ab95ab7d34d5): created successfully
Apr 24 19:53:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a6d1ab-2a8c-484f-9d79-9599a2d1bcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Flow 'volume_create_manager' (7f520637-8126-44d8-bf87-d06971334a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:53:10 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-95908d2c-b89f-4f55-85df-9a8e8589253c tempest-VolumeQuotasAdminTestJSON-473337074 None] Created volume successfully.
Apr 24 19:53:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Acquiring lock "cinder-ef06be83-b61f-473c-9a55-ab95ab7d34d5-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:53:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Lock "cinder-ef06be83-b61f-473c-9a55-ab95ab7d34d5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:53:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Acquiring lock "cinder-quobyte-ef06be83-b61f-473c-9a55-ab95ab7d34d5" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:53:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Lock "cinder-quobyte-ef06be83-b61f-473c-9a55-ab95ab7d34d5" acquired by "delete_volume" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:53:11 devstack cinder-volume[81241]: INFO oslo.privsep.daemon [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpwyl8kxsi/privsep.sock']
Apr 24 19:53:11 devstack sudo[82047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpwyl8kxsi/privsep.sock
Apr 24 19:53:11 devstack sudo[82047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 24 19:53:12 devstack cinder-volume[81241]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 24 19:53:13 devstack sudo[82047]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:13 devstack cinder-volume[81241]: INFO oslo.privsep.daemon [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Spawned new privsep daemon via rootwrap
Apr 24 19:53:13 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Accepted privsep connection to /tmp/tmpwyl8kxsi/privsep.sock {{(pid=81241) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 24 19:53:13 devstack cinder-volume[81241]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 24 19:53:13 devstack cinder-volume[81241]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 24 19:53:13 devstack cinder-volume[81241]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 24 19:53:13 devstack cinder-volume[81241]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82087
Apr 24 19:53:13 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afcbe69-2a73-4407-991c-cee6b337a233]: (2,) {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:53:13 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[700c4a4b-1046-4cd8-922e-628dd381e29a]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:53:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:13 devstack sudo[82094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5
Apr 24 19:53:13 devstack sudo[82094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:15 devstack sudo[82094]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5" returned: 0 in 1.545s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:15 devstack sudo[82117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5
Apr 24 19:53:15 devstack sudo[82117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:15 devstack cinder-volume[81241]: WARNING py.warnings [req-a738b1e6-70ce-4f52-aae9-688ff8a0e051 req-a78d86a6-a821-4c58-8e20-cfd574eb9d16 tempest-DeleteServersTestJSON-1599888503 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Apr 24 19:53:15 devstack cinder-volume[81241]:   .first()
Apr 24 19:53:15 devstack cinder-volume[81241]: 
Apr 24 19:53:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-a738b1e6-70ce-4f52-aae9-688ff8a0e051 req-a78d86a6-a821-4c58-8e20-cfd574eb9d16 tempest-DeleteServersTestJSON-1599888503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-a738b1e6-70ce-4f52-aae9-688ff8a0e051 req-a78d86a6-a821-4c58-8e20-cfd574eb9d16 tempest-DeleteServersTestJSON-1599888503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:15 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[601af885-3221-4827-b922-a86bb913cb36]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:53:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-a738b1e6-70ce-4f52-aae9-688ff8a0e051 req-a78d86a6-a821-4c58-8e20-cfd574eb9d16 tempest-DeleteServersTestJSON-1599888503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:15 devstack sudo[82119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e
Apr 24 19:53:15 devstack sudo[82119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:16 devstack sudo[82117]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef06be83-b61f-473c-9a55-ab95ab7d34d5" returned: 0 in 0.873s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Lock "cinder-quobyte-ef06be83-b61f-473c-9a55-ab95ab7d34d5" released by "delete_volume" :: held 4.464s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:53:16 devstack cinder-volume[81241]: WARNING cinder.quota [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 24 19:53:16 devstack cinder-volume[81241]: WARNING cinder.quota [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Created reservations ['115753a3-cb35-4530-8247-7998858fdb79', 'e9b18b81-a785-487c-9a26-e79a8470686c', 'da7b7282-a090-4eec-93d8-715c04a8b258', '35220913-ca99-499f-80d3-7276858f477e'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:16 devstack sudo[82125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:53:16 devstack sudo[82125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Flow 'volume_create_manager' (062f15dd-da6b-4e7c-a4c1-220514ee57b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b1c3d4-8c82-4ab5-b375-e15bad916000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:16 devstack sudo[82119]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b1c3d4-8c82-4ab5-b375-e15bad916000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-169094124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f40136d-9ca5-47c0-91bd-44f30a63c89e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf6e86a15a242fab40408b7634faeff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:17Z,use_quota=True,user_id='44fa245973864ee58d1675418e2f2caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72d81d6-fffe-4511-a110-1bf8d15a5373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72d81d6-fffe-4511-a110-1bf8d15a5373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f61e5a6-a41f-400c-8da9-8a7c40412013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f61e5a6-a41f-400c-8da9-8a7c40412013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f40136d-9ca5-47c0-91bd-44f30a63c89e', 'volume_name': 'volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c275f9-3620-48c9-bdc1-5215a9da2b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c275f9-3620-48c9-bdc1-5215a9da2b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8b8862-5b1c-408f-8b87-e72be6c83919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:16 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Volume 8f40136d-9ca5-47c0-91bd-44f30a63c89e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e', 'volume_size': 1}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-a738b1e6-70ce-4f52-aae9-688ff8a0e051 req-a78d86a6-a821-4c58-8e20-cfd574eb9d16 tempest-DeleteServersTestJSON-1599888503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e" returned: 0 in 1.389s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-a738b1e6-70ce-4f52-aae9-688ff8a0e051 req-a78d86a6-a821-4c58-8e20-cfd574eb9d16 tempest-DeleteServersTestJSON-1599888503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.442s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.052s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-169094124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f40136d-9ca5-47c0-91bd-44f30a63c89e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf6e86a15a242fab40408b7634faeff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:17Z,use_quota=True,user_id='44fa245973864ee58d1675418e2f2caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Creating volume 8f40136d-9ca5-47c0-91bd-44f30a63c89e {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:53:16 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-a738b1e6-70ce-4f52-aae9-688ff8a0e051 req-a78d86a6-a821-4c58-8e20-cfd574eb9d16 tempest-DeleteServersTestJSON-1599888503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e', 'name': 'volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '982f4045-0480-430a-ad9d-708e1fcb61c4', 'enforce_multipath': True} {{(pid=81241) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 24 19:53:16 devstack sudo[82127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e 1073741824
Apr 24 19:53:16 devstack sudo[82127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:17 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-a738b1e6-70ce-4f52-aae9-688ff8a0e051 req-a78d86a6-a821-4c58-8e20-cfd574eb9d16 tempest-DeleteServersTestJSON-1599888503 None] attachment_update completed successfully.
Apr 24 19:53:17 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:53:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Flow 'volume_create_manager' (b9f4128e-68df-49fa-b7d7-a48c7925e050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:53:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac846221-105b-4ba5-a779-c8f73bd77f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac846221-105b-4ba5-a779-c8f73bd77f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-488814494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1eeed4-bf6d-4341-8073-5d39e9767aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236e1c10db284972ab989403d9fc0a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:17Z,use_quota=True,user_id='86fb8912541148aebea7e828dc281272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d37bf2-8c2b-4545-87a4-3147986eb536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d37bf2-8c2b-4545-87a4-3147986eb536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a8743f-6fcb-4177-a60f-62522bdd6b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a8743f-6fcb-4177-a60f-62522bdd6b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1eeed4-bf6d-4341-8073-5d39e9767aa2', 'volume_name': 'volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2982e998-582b-40b6-a609-6f33b5c11226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2982e998-582b-40b6-a609-6f33b5c11226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0eb636-0a55-4c06-9a82-5b4eef4f68f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:17 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Volume 4e1eeed4-bf6d-4341-8073-5d39e9767aa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2', 'volume_size': 1}
Apr 24 19:53:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:18 devstack sudo[82125]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.724s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:18 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:53:18 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Deleted volume successfully.
Apr 24 19:53:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2f59411d-10f0-4595-9919-8c427957b8ac tempest-VolumeQuotasAdminTestJSON-473337074 None] Lock "cinder-ef06be83-b61f-473c-9a55-ab95ab7d34d5-delete_volume" released by "delete_volume" :: held 6.714s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:53:18 devstack sudo[82127]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e 1073741824" returned: 0 in 1.471s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:18 devstack sudo[82201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e
Apr 24 19:53:18 devstack sudo[82201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:19 devstack sudo[82201]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e" returned: 0 in 0.652s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-488814494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1eeed4-bf6d-4341-8073-5d39e9767aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236e1c10db284972ab989403d9fc0a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:17Z,use_quota=True,user_id='86fb8912541148aebea7e828dc281272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Creating volume 4e1eeed4-bf6d-4341-8073-5d39e9767aa2 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:53:19 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8b8862-5b1c-408f-8b87-e72be6c83919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811ad375-b840-48e5-b0e8-fd05109778c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:19 devstack sudo[82529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2 1073741824
Apr 24 19:53:19 devstack sudo[82529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:19 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Volume volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e (8f40136d-9ca5-47c0-91bd-44f30a63c89e): created successfully
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811ad375-b840-48e5-b0e8-fd05109778c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:19 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Flow 'volume_create_manager' (062f15dd-da6b-4e7c-a4c1-220514ee57b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:53:19 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b367870c-7947-4c8c-b6b9-4c851e0c44b9 tempest-VolumesAdminNegativeTest-1169351033 None] Created volume successfully.
Apr 24 19:53:20 devstack sudo[82529]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2 1073741824" returned: 0 in 1.308s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:20 devstack sudo[82537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2
Apr 24 19:53:20 devstack sudo[82537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Acquiring lock "cinder-8f40136d-9ca5-47c0-91bd-44f30a63c89e-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:53:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Lock "cinder-8f40136d-9ca5-47c0-91bd-44f30a63c89e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:53:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Acquiring lock "cinder-quobyte-8f40136d-9ca5-47c0-91bd-44f30a63c89e" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:53:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Lock "cinder-quobyte-8f40136d-9ca5-47c0-91bd-44f30a63c89e" acquired by "delete_volume" :: waited 0.026s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:53:20 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[445fccb7-c51e-41f4-b4e5-45d5a4365b96]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:53:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:21 devstack sudo[82539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e
Apr 24 19:53:21 devstack sudo[82539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:21 devstack sudo[82537]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2" returned: 0 in 0.727s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:21 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] <== create_volume: return (2090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:53:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:21 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0eb636-0a55-4c06-9a82-5b4eef4f68f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:21 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d48d7d4-756b-4f5e-9325-ca022750eddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:21 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Volume volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2 (4e1eeed4-bf6d-4341-8073-5d39e9767aa2): created successfully
Apr 24 19:53:21 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d48d7d4-756b-4f5e-9325-ca022750eddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:21 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Flow 'volume_create_manager' (b9f4128e-68df-49fa-b7d7-a48c7925e050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:53:21 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-3d54ff3d-1cd8-40ae-9ffc-9953f26f2165 tempest-VolumeQuotasAdminTestJSON-473337074 None] Created volume successfully.
Apr 24 19:53:21 devstack sudo[82539]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e" returned: 0 in 0.713s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:21 devstack sudo[82545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e
Apr 24 19:53:21 devstack sudo[82545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:22 devstack sudo[82545]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8f40136d-9ca5-47c0-91bd-44f30a63c89e" returned: 0 in 0.789s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Lock "cinder-quobyte-8f40136d-9ca5-47c0-91bd-44f30a63c89e" released by "delete_volume" :: held 1.577s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:53:22 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Created reservations ['b62a1368-d9a4-4d21-af6b-df9f65d54080', '07185ba5-2538-4284-ab49-34caf77048fa', '1cefac2f-d9bf-4324-a30d-238bae98601f', 'cf0d9ba4-2aba-4991-b5f4-4cbe92b16a62'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:53:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:22 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:22 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:22 devstack sudo[82551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:53:22 devstack sudo[82551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:23 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-cfd6247a-ae6d-4f50-8574-9649300cbd6c tempest-VolumeQuotasAdminTestJSON-322402400 None] Transfer volume completed successfully.
Apr 24 19:53:23 devstack sudo[82551]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.986s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:23 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:53:23 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Deleted volume successfully.
Apr 24 19:53:23 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0fc0b0d9-3e6f-4b64-beaa-2ac29fa1e335 tempest-VolumesAdminNegativeTest-1169351033 None] Lock "cinder-8f40136d-9ca5-47c0-91bd-44f30a63c89e-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:53:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 19:53:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:24 devstack sudo[82563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:53:24 devstack sudo[82563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Acquiring lock "cinder-4e1eeed4-bf6d-4341-8073-5d39e9767aa2-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:53:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Lock "cinder-4e1eeed4-bf6d-4341-8073-5d39e9767aa2-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:53:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Acquiring lock "cinder-quobyte-4e1eeed4-bf6d-4341-8073-5d39e9767aa2" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:53:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Lock "cinder-quobyte-4e1eeed4-bf6d-4341-8073-5d39e9767aa2" acquired by "delete_volume" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:53:24 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdd0a3d-b45e-4ba9-9bed-7a6b8cfdae7f]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:53:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:24 devstack sudo[82563]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.879s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:24 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:53:24 devstack sudo[82602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2
Apr 24 19:53:24 devstack sudo[82602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:25 devstack sudo[82602]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2" returned: 0 in 0.743s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:25 devstack sudo[82659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2
Apr 24 19:53:25 devstack sudo[82659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:26 devstack sudo[82659]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e1eeed4-bf6d-4341-8073-5d39e9767aa2" returned: 0 in 0.574s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Lock "cinder-quobyte-4e1eeed4-bf6d-4341-8073-5d39e9767aa2" released by "delete_volume" :: held 1.365s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:53:26 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Created reservations ['fe41b23b-5b6f-4d7a-bfdb-02e4d3d6acf7', 'b7a1ddda-eaf4-4a22-8f7e-fa3a39d4cae6', '2edd3cdc-2e31-44b0-b2ec-4e1fe5ed7240', 'f483b5c7-e850-407b-83de-c2054295d9d9'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:53:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:26 devstack sudo[82666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:53:26 devstack sudo[82666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:26 devstack sudo[82666]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.486s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:26 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:53:26 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Deleted volume successfully.
Apr 24 19:53:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-72ba2167-0b79-4c7d-ad66-bb7a4d5497b9 tempest-VolumeQuotasAdminTestJSON-1745361270 None] Lock "cinder-4e1eeed4-bf6d-4341-8073-5d39e9767aa2-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:53:28 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-946f2d23-5d6d-4907-9faa-40f8ca832eb8 req-a2b1b42b-ab2c-474b-a9ab-330564b09f95 tempest-DeleteServersTestJSON-1599888503 None] Terminate volume connection completed successfully.
Apr 24 19:53:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-946f2d23-5d6d-4907-9faa-40f8ca832eb8 req-a2b1b42b-ab2c-474b-a9ab-330564b09f95 tempest-DeleteServersTestJSON-1599888503 None] Deleting attachment 982f4045-0480-430a-ad9d-708e1fcb61c4. {{(pid=81241) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 24 19:53:33 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Acquiring lock "cinder-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:53:33 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Lock "cinder-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:53:33 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Acquiring lock "cinder-quobyte-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:53:33 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Lock "cinder-quobyte-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:53:33 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b178a0a-729c-4edb-b543-aa28f0082069]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:53:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:33 devstack sudo[82679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e
Apr 24 19:53:33 devstack sudo[82679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:34 devstack sudo[82679]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e" returned: 0 in 0.769s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:34 devstack sudo[82685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e
Apr 24 19:53:34 devstack sudo[82685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:34 devstack sudo[82685]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e" returned: 0 in 0.555s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:34 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Lock "cinder-quobyte-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e" released by "delete_volume" :: held 1.393s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:53:34 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Created reservations ['086573d2-2d6c-44fb-8c89-c9f4454c7c28', '5a9ce7a5-579f-410f-bc17-a878f6303659', 'e0618361-ba9b-46ba-a92f-6e510f04c5cb', '8eace451-22bb-4c30-9674-70f5bb8f19cb'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:35 devstack sudo[82688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:53:35 devstack sudo[82688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Flow 'volume_create_manager' (4927a0af-98ba-437a-8063-983058754fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efbfb58-4ab0-4580-8a60-ca9c7640f709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efbfb58-4ab0-4580-8a60-ca9c7640f709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1893160728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ca8c05-c561-4122-a886-6c81efc893a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a619684617f433eac8fd9a75ef7a9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:35Z,use_quota=True,user_id='899f3348b94640dd907195276807cbbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6791e096-478f-4333-b61f-d20eb8a789b0),volume_type_id=6791e096-478f-4333-b61f-d20eb8a789b0)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c08461-fb95-4c8d-901f-b0790df9f63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c08461-fb95-4c8d-901f-b0790df9f63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b9d486-8e01-4200-92e6-18803fcad3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b9d486-8e01-4200-92e6-18803fcad3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ca8c05-c561-4122-a886-6c81efc893a4', 'volume_name': 'volume-f6ca8c05-c561-4122-a886-6c81efc893a4', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476491b8-234e-477c-8ddb-10a0412cfd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476491b8-234e-477c-8ddb-10a0412cfd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99b8fb4-1180-4be5-9dc3-995b9ac701fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:35 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Volume f6ca8c05-c561-4122-a886-6c81efc893a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ca8c05-c561-4122-a886-6c81efc893a4', 'volume_size': 1}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1893160728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ca8c05-c561-4122-a886-6c81efc893a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a619684617f433eac8fd9a75ef7a9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:35Z,use_quota=True,user_id='899f3348b94640dd907195276807cbbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6791e096-478f-4333-b61f-d20eb8a789b0),volume_type_id=6791e096-478f-4333-b61f-d20eb8a789b0)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Creating volume f6ca8c05-c561-4122-a886-6c81efc893a4 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:53:35 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6ca8c05-c561-4122-a886-6c81efc893a4 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:35 devstack sudo[82691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6ca8c05-c561-4122-a886-6c81efc893a4 1073741824
Apr 24 19:53:35 devstack sudo[82691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:35 devstack sudo[82688]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.667s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:53:35 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Deleted volume successfully.
Apr 24 19:53:35 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-54146881-882f-43a5-8766-0154f99d99bc tempest-DeleteServersTestJSON-1599888503 None] Lock "cinder-ea0dfbc0-543c-4a57-b95d-bcf05d23f84e-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:53:36 devstack sudo[82691]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6ca8c05-c561-4122-a886-6c81efc893a4 1073741824" returned: 0 in 0.948s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6ca8c05-c561-4122-a886-6c81efc893a4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:36 devstack sudo[82730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6ca8c05-c561-4122-a886-6c81efc893a4
Apr 24 19:53:36 devstack sudo[82730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:37 devstack sudo[82730]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6ca8c05-c561-4122-a886-6c81efc893a4" returned: 0 in 0.689s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99b8fb4-1180-4be5-9dc3-995b9ac701fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ca8c05-c561-4122-a886-6c81efc893a4', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0bd74e-a92b-488e-8373-fc4ffe40ca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Flow 'volume_create_manager' (a480edcf-4a1d-4038-9bd3-9d8c68368b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43605675-7851-405a-8bbf-8540da919b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43605675-7851-405a-8bbf-8540da919b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1908995789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364d9a0d-3f72-4c6e-a246-e29ae982946b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1d6625af9424bfa9f8cc2ac58ded944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:37Z,use_quota=True,user_id='3ad5f22bfb3e42798f55475247f81e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68ea541-ede2-4f9a-97fb-2a2a5f3b4c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68ea541-ede2-4f9a-97fb-2a2a5f3b4c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bcbd8fe-1b51-4385-8d61-b53cb77f8a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bcbd8fe-1b51-4385-8d61-b53cb77f8a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '364d9a0d-3f72-4c6e-a246-e29ae982946b', 'volume_name': 'volume-364d9a0d-3f72-4c6e-a246-e29ae982946b', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e557b1c-039d-4376-96fe-0bef146925d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e557b1c-039d-4376-96fe-0bef146925d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ee2d9a-0cc2-4cf4-8b0d-2d440073da24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:37 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Volume 364d9a0d-3f72-4c6e-a246-e29ae982946b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-364d9a0d-3f72-4c6e-a246-e29ae982946b', 'volume_size': 1}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1908995789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364d9a0d-3f72-4c6e-a246-e29ae982946b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1d6625af9424bfa9f8cc2ac58ded944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:37Z,use_quota=True,user_id='3ad5f22bfb3e42798f55475247f81e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Creating volume 364d9a0d-3f72-4c6e-a246-e29ae982946b {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:53:37 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-364d9a0d-3f72-4c6e-a246-e29ae982946b 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:37 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Volume volume-f6ca8c05-c561-4122-a886-6c81efc893a4 (f6ca8c05-c561-4122-a886-6c81efc893a4): created successfully
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0bd74e-a92b-488e-8373-fc4ffe40ca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Flow 'volume_create_manager' (4927a0af-98ba-437a-8063-983058754fe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:53:37 devstack sudo[82734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-364d9a0d-3f72-4c6e-a246-e29ae982946b 1073741824
Apr 24 19:53:37 devstack sudo[82734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:37 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d82b4ee0-da44-454d-8d5e-bfd41436c12d tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Created volume successfully.
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a45b5fd7-6f23-4c3f-b2fb-95905bbdb14e tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a45b5fd7-6f23-4c3f-b2fb-95905bbdb14e tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a45b5fd7-6f23-4c3f-b2fb-95905bbdb14e tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a45b5fd7-6f23-4c3f-b2fb-95905bbdb14e tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a45b5fd7-6f23-4c3f-b2fb-95905bbdb14e tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a45b5fd7-6f23-4c3f-b2fb-95905bbdb14e tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:38 devstack sudo[82741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:53:38 devstack sudo[82741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:38 devstack sudo[82734]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-364d9a0d-3f72-4c6e-a246-e29ae982946b 1073741824" returned: 0 in 0.800s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-364d9a0d-3f72-4c6e-a246-e29ae982946b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:38 devstack sudo[82743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-364d9a0d-3f72-4c6e-a246-e29ae982946b
Apr 24 19:53:38 devstack sudo[82743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:38 devstack sudo[82741]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a45b5fd7-6f23-4c3f-b2fb-95905bbdb14e tempest-VolumeRetypeWithoutMigrationTest-135126394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.520s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-a45b5fd7-6f23-4c3f-b2fb-95905bbdb14e tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:53:38 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a45b5fd7-6f23-4c3f-b2fb-95905bbdb14e tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Retype volume completed successfully.
Apr 24 19:53:38 devstack sudo[82743]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-364d9a0d-3f72-4c6e-a246-e29ae982946b" returned: 0 in 0.585s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ee2d9a-0cc2-4cf4-8b0d-2d440073da24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364d9a0d-3f72-4c6e-a246-e29ae982946b', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed47856-274b-4ab6-957b-3bb7a6efa204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:38 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Volume volume-364d9a0d-3f72-4c6e-a246-e29ae982946b (364d9a0d-3f72-4c6e-a246-e29ae982946b): created successfully
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed47856-274b-4ab6-957b-3bb7a6efa204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Flow 'volume_create_manager' (a480edcf-4a1d-4038-9bd3-9d8c68368b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:53:38 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-7319fa8e-96be-407b-9eb4-9b3a2c9404d7 req-fdc8f661-a06e-4bb1-a411-3ffa5f800701 tempest-VolumesGetTestJSON-34050706 None] Created volume successfully.
Apr 24 19:53:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Acquiring lock "cinder-f6ca8c05-c561-4122-a886-6c81efc893a4-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:53:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Lock "cinder-f6ca8c05-c561-4122-a886-6c81efc893a4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:53:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Acquiring lock "cinder-quobyte-f6ca8c05-c561-4122-a886-6c81efc893a4" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:53:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Lock "cinder-quobyte-f6ca8c05-c561-4122-a886-6c81efc893a4" acquired by "delete_volume" :: waited 0.046s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:53:39 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f54082c-3bb8-447f-9b30-0b3b8f809cf8]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:53:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6ca8c05-c561-4122-a886-6c81efc893a4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:39 devstack sudo[82750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6ca8c05-c561-4122-a886-6c81efc893a4
Apr 24 19:53:39 devstack sudo[82750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Acquiring lock "cinder-364d9a0d-3f72-4c6e-a246-e29ae982946b-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:53:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Lock "cinder-364d9a0d-3f72-4c6e-a246-e29ae982946b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:53:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Acquiring lock "cinder-quobyte-364d9a0d-3f72-4c6e-a246-e29ae982946b" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:53:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Lock "cinder-quobyte-364d9a0d-3f72-4c6e-a246-e29ae982946b" acquired by "delete_volume" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:53:39 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e951751a-14f0-4f8d-a8c2-5c83bfd34496]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:53:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-364d9a0d-3f72-4c6e-a246-e29ae982946b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:40 devstack sudo[82753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-364d9a0d-3f72-4c6e-a246-e29ae982946b
Apr 24 19:53:40 devstack sudo[82753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:40 devstack sudo[82750]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6ca8c05-c561-4122-a886-6c81efc893a4" returned: 0 in 0.756s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6ca8c05-c561-4122-a886-6c81efc893a4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:40 devstack sudo[82759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6ca8c05-c561-4122-a886-6c81efc893a4
Apr 24 19:53:40 devstack sudo[82759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:40 devstack sudo[82753]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-364d9a0d-3f72-4c6e-a246-e29ae982946b" returned: 0 in 0.781s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-364d9a0d-3f72-4c6e-a246-e29ae982946b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:40 devstack sudo[82764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-364d9a0d-3f72-4c6e-a246-e29ae982946b
Apr 24 19:53:40 devstack sudo[82764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:40 devstack sudo[82759]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6ca8c05-c561-4122-a886-6c81efc893a4" returned: 0 in 0.639s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Lock "cinder-quobyte-f6ca8c05-c561-4122-a886-6c81efc893a4" released by "delete_volume" :: held 1.447s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:53:41 devstack cinder-volume[81241]: WARNING cinder.quota [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 24 19:53:41 devstack cinder-volume[81241]: WARNING cinder.quota [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Created reservations ['7c6dbc82-f9c5-4e67-980a-9440ffc8860c', '2813917f-c73c-4c6b-ad35-95831abe9f1a', 'f62dd3b8-4c2c-48a8-854d-bd86e2246655', '6e9e22c1-dcf5-47f3-8029-54f56393d925'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:41 devstack sudo[82768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:53:41 devstack sudo[82768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:41 devstack sudo[82764]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-364d9a0d-3f72-4c6e-a246-e29ae982946b" returned: 0 in 0.697s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Lock "cinder-quobyte-364d9a0d-3f72-4c6e-a246-e29ae982946b" released by "delete_volume" :: held 1.530s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG cinder.quota [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Created reservations ['76141445-4f2a-4c91-b93c-588c39d47984', 'a675e6e7-048a-4491-9b54-0adb6a06a211', '75cbf3f7-4811-4070-9b64-967d8bb06c23', 'f8a04628-c4b4-4d5f-822d-0e776d82b1f1'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:41 devstack sudo[82770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:53:41 devstack sudo[82770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:41 devstack sudo[82768]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.685s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:41 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:53:42 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Deleted volume successfully.
Apr 24 19:53:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-36f948f8-8976-42e8-a326-829032379e00 tempest-VolumeRetypeWithoutMigrationTest-135126394 None] Lock "cinder-f6ca8c05-c561-4122-a886-6c81efc893a4-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:53:42 devstack sudo[82770]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.741s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:42 devstack cinder-volume[81241]: DEBUG cinder.manager [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:53:42 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Deleted volume successfully.
Apr 24 19:53:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-d709a548-ab30-4e9b-b9c5-7f857aee7f38 req-529715a7-167f-4391-ac68-29cbdba96d4d tempest-VolumesGetTestJSON-34050706 None] Lock "cinder-364d9a0d-3f72-4c6e-a246-e29ae982946b-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:53:51 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=54,cinder:UPDATE=79,cinder:INSERT=15,cinder:DELETE=6 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=58,cinder:UPDATE=65,cinder:DELETE=6,cinder:INSERT=15 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Flow 'volume_create_manager' (f89cb614-ce88-42ba-96f2-4ec311eab47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915f29fb-66ad-4f45-9031-7e5f99c2b1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915f29fb-66ad-4f45-9031-7e5f99c2b1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-450859020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3ec97c94e54a41b01fcb2dcbb60916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:52Z,use_quota=True,user_id='070d4544d6ab471faaa3be258e3db1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e72237b2-8bdc-43c2-995d-855888eea790),volume_type_id=e72237b2-8bdc-43c2-995d-855888eea790)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7125d558-2935-4945-bfc1-45a0071ac709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7125d558-2935-4945-bfc1-45a0071ac709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1946e332-6827-47a1-aec2-cb19fdfdfb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1946e332-6827-47a1-aec2-cb19fdfdfb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f', 'volume_name': 'volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8da7c8-8c55-4485-bf4a-04e89b5c4839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8da7c8-8c55-4485-bf4a-04e89b5c4839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64d1f55-ef63-4a92-96ef-2d1693835aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:52 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Volume e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f', 'volume_size': 1}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-450859020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3ec97c94e54a41b01fcb2dcbb60916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:52Z,use_quota=True,user_id='070d4544d6ab471faaa3be258e3db1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e72237b2-8bdc-43c2-995d-855888eea790),volume_type_id=e72237b2-8bdc-43c2-995d-855888eea790)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Creating volume e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:53:52 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:53:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:52 devstack sudo[82778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f 1073741824
Apr 24 19:53:52 devstack sudo[82778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:53 devstack sudo[82778]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f 1073741824" returned: 0 in 0.786s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:53 devstack sudo[82783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f
Apr 24 19:53:53 devstack sudo[82783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:53 devstack sudo[82783]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f" returned: 0 in 0.578s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:53 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:53:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64d1f55-ef63-4a92-96ef-2d1693835aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef080f0-51c9-4955-87f8-d58e8e44cdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:53:53 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Volume volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f (e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f): created successfully
Apr 24 19:53:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef080f0-51c9-4955-87f8-d58e8e44cdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:53:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Flow 'volume_create_manager' (f89cb614-ce88-42ba-96f2-4ec311eab47a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:53:53 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0c12269c-7fad-48f7-a961-1b107c57176d tempest-VolumeTypesAccessTest-170591375 None] Created volume successfully.
Apr 24 19:53:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Acquiring lock "cinder-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:53:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Lock "cinder-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:53:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Acquiring lock "cinder-quobyte-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:53:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Lock "cinder-quobyte-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:53:54 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3903b483-c1aa-4192-8cb1-0eebce7367f6]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:53:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:54 devstack sudo[82788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f
Apr 24 19:53:54 devstack sudo[82788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:55 devstack sudo[82788]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f" returned: 0 in 0.741s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:55 devstack sudo[82793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f
Apr 24 19:53:55 devstack sudo[82793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:56 devstack sudo[82793]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f" returned: 0 in 0.835s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Lock "cinder-quobyte-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f" released by "delete_volume" :: held 1.642s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:53:56 devstack cinder-volume[81241]: WARNING cinder.quota [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-383564745 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-383564745, it is now deprecated. Please use the default quota class for default quota.
Apr 24 19:53:56 devstack cinder-volume[81241]: WARNING cinder.quota [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-383564745 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-383564745, it is now deprecated. Please use the default quota class for default quota.
Apr 24 19:53:56 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Created reservations ['6fe210a4-dc19-4a0e-ac2d-57e02b200495', '28a6cd9b-1a5d-42e9-9831-5b33b9057780', '8a8aad7a-dcd0-4bac-94d2-5d7c8ef1f761', '6edde5d9-9c06-4df2-bf5b-a079a4d3f887'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:53:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:53:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:53:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:53:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:53:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:53:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:53:56 devstack sudo[82796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:53:56 devstack sudo[82796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:53:57 devstack sudo[82796]: pam_unix(sudo:session): session closed for user root
Apr 24 19:53:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.855s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:53:57 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:53:57 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Deleted volume successfully.
Apr 24 19:53:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b077f970-f28c-4924-a5a7-7fad023c4759 tempest-VolumeTypesAccessTest-170591375 None] Lock "cinder-e5f83ad3-d52e-4dbf-892d-ddba1d9bd77f-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:53:59 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c386f765-f526-4803-8626-a173a616c9cc tempest-GroupsTest-255372762 None] Group tempest-Group1-1174751835: creating
Apr 24 19:53:59 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c386f765-f526-4803-8626-a173a616c9cc tempest-GroupsTest-255372762 None] Group tempest-Group1-1174751835: created successfully
Apr 24 19:53:59 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c386f765-f526-4803-8626-a173a616c9cc tempest-GroupsTest-255372762 None] Create group completed successfully.
Apr 24 19:54:00 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8be32fce-e944-4a69-80d5-b6dff24e0175 tempest-GroupsTest-255372762 None] Group tempest-Group2-1285619979: creating
Apr 24 19:54:00 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8be32fce-e944-4a69-80d5-b6dff24e0175 tempest-GroupsTest-255372762 None] Group tempest-Group2-1285619979: created successfully
Apr 24 19:54:00 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8be32fce-e944-4a69-80d5-b6dff24e0175 tempest-GroupsTest-255372762 None] Create group completed successfully.
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Flow 'volume_create_manager' (c16698eb-ba03-4f18-9ab3-821075385edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827e3590-2674-4756-8a56-695095e7b5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827e3590-2674-4756-8a56-695095e7b5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-671267582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c7684117-f18e-47e4-9997-e32d359f0229,host='devstack@QuobyteHD#QuobyteHD',id=c9f9cb17-8a48-499b-9552-8b699f064671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3392eda644437999255b56273aac15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:02Z,use_quota=True,user_id='23bfe239a9d546478177ae7b02207ede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37476ae5-aaae-43a8-aeae-92fbbb55412d),volume_type_id=37476ae5-aaae-43a8-aeae-92fbbb55412d)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39d2e80-599c-4ace-a284-0e2f572f70a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39d2e80-599c-4ace-a284-0e2f572f70a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a50ca0-a565-4c10-a411-4c13b45a1e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a50ca0-a565-4c10-a411-4c13b45a1e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f9cb17-8a48-499b-9552-8b699f064671', 'volume_name': 'volume-c9f9cb17-8a48-499b-9552-8b699f064671', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17474c6b-100d-4175-805e-2728c16c29f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17474c6b-100d-4175-805e-2728c16c29f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7008b23-3c8b-472f-891a-b4ebb395f8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:02 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Volume c9f9cb17-8a48-499b-9552-8b699f064671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f9cb17-8a48-499b-9552-8b699f064671', 'volume_size': 1}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c7684117-f18e-47e4-9997-e32d359f0229,created_at=2026-04-24T17:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-671267582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c7684117-f18e-47e4-9997-e32d359f0229,host='devstack@QuobyteHD#QuobyteHD',id=c9f9cb17-8a48-499b-9552-8b699f064671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3392eda644437999255b56273aac15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:02Z,use_quota=True,user_id='23bfe239a9d546478177ae7b02207ede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37476ae5-aaae-43a8-aeae-92fbbb55412d),volume_type_id=37476ae5-aaae-43a8-aeae-92fbbb55412d)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Creating volume c9f9cb17-8a48-499b-9552-8b699f064671 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:54:02 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:54:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c9f9cb17-8a48-499b-9552-8b699f064671 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:02 devstack sudo[82816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c9f9cb17-8a48-499b-9552-8b699f064671 1073741824
Apr 24 19:54:02 devstack sudo[82816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:03 devstack sudo[82816]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c9f9cb17-8a48-499b-9552-8b699f064671 1073741824" returned: 0 in 0.947s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c9f9cb17-8a48-499b-9552-8b699f064671 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:03 devstack sudo[82821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c9f9cb17-8a48-499b-9552-8b699f064671
Apr 24 19:54:03 devstack sudo[82821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:04 devstack sudo[82821]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c9f9cb17-8a48-499b-9552-8b699f064671" returned: 0 in 0.745s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:54:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7008b23-3c8b-472f-891a-b4ebb395f8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f9cb17-8a48-499b-9552-8b699f064671', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb31f575-c214-4a33-8459-fda922828f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:04 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Volume volume-c9f9cb17-8a48-499b-9552-8b699f064671 (c9f9cb17-8a48-499b-9552-8b699f064671): created successfully
Apr 24 19:54:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb31f575-c214-4a33-8459-fda922828f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Flow 'volume_create_manager' (c16698eb-ba03-4f18-9ab3-821075385edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:54:04 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e3de2b67-39bf-4a74-90f7-b7cda0b696b2 tempest-GroupsTest-255372762 None] Created volume successfully.
Apr 24 19:54:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Acquiring lock "cinder-quobyte-c9f9cb17-8a48-499b-9552-8b699f064671" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:54:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Lock "cinder-quobyte-c9f9cb17-8a48-499b-9552-8b699f064671" acquired by "delete_volume" :: waited 0.038s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:54:05 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7652b1-91ca-4886-bef9-e46247a2b169]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:54:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c9f9cb17-8a48-499b-9552-8b699f064671 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:06 devstack sudo[82842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c9f9cb17-8a48-499b-9552-8b699f064671
Apr 24 19:54:06 devstack sudo[82842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:06 devstack sudo[82842]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c9f9cb17-8a48-499b-9552-8b699f064671" returned: 0 in 0.788s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c9f9cb17-8a48-499b-9552-8b699f064671 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:06 devstack sudo[82857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c9f9cb17-8a48-499b-9552-8b699f064671
Apr 24 19:54:06 devstack sudo[82857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:07 devstack sudo[82857]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c9f9cb17-8a48-499b-9552-8b699f064671" returned: 0 in 0.653s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Lock "cinder-quobyte-c9f9cb17-8a48-499b-9552-8b699f064671" released by "delete_volume" :: held 1.511s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:54:07 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Created reservations ['57e02791-6006-4b04-bf40-973fb26da5af'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:54:07 devstack cinder-volume[81241]: WARNING cinder.quota [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1193375086 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1193375086, it is now deprecated. Please use the default quota class for default quota.
Apr 24 19:54:07 devstack cinder-volume[81241]: WARNING cinder.quota [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1193375086 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1193375086, it is now deprecated. Please use the default quota class for default quota.
Apr 24 19:54:07 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Created reservations ['f3de1f51-5659-462f-aa6b-9b26e3f1610f', '8ec3e83d-c61c-41ab-b865-6093df289dcf', 'f6afb769-4e09-4be2-9fff-3223b2da84c3', '488611fc-46f7-456a-b496-3a37110e286a'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:54:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:54:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:54:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:07 devstack sudo[82865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:54:07 devstack sudo[82865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:08 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-bf54675e-2b8f-481e-98e9-45363c8bc4ee tempest-GroupsTest-255372762 None] Created reservations ['56e619f1-1ab4-46bc-be30-31ef2ed25712'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:54:08 devstack sudo[82865]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-bf54675e-2b8f-481e-98e9-45363c8bc4ee tempest-GroupsTest-255372762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-bf54675e-2b8f-481e-98e9-45363c8bc4ee tempest-GroupsTest-255372762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-bf54675e-2b8f-481e-98e9-45363c8bc4ee tempest-GroupsTest-255372762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:54:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-bf54675e-2b8f-481e-98e9-45363c8bc4ee tempest-GroupsTest-255372762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:54:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-bf54675e-2b8f-481e-98e9-45363c8bc4ee tempest-GroupsTest-255372762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bf54675e-2b8f-481e-98e9-45363c8bc4ee tempest-GroupsTest-255372762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.730s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:08 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:54:08 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e86c27e6-510e-4a65-bba1-9e51fece26b2 tempest-GroupsTest-255372762 None] Delete group completed successfully.
Apr 24 19:54:08 devstack sudo[82868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:54:08 devstack sudo[82868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:09 devstack sudo[82868]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bf54675e-2b8f-481e-98e9-45363c8bc4ee tempest-GroupsTest-255372762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.608s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:09 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-bf54675e-2b8f-481e-98e9-45363c8bc4ee tempest-GroupsTest-255372762 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:54:09 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-bf54675e-2b8f-481e-98e9-45363c8bc4ee tempest-GroupsTest-255372762 None] Delete group completed successfully.
Apr 24 19:54:10 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-670691d9-2234-40b6-ad20-6019124f5537 tempest-GroupsTest-255372762 None] Group tempest-GroupsTest-Group-284321739: creating
Apr 24 19:54:10 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-670691d9-2234-40b6-ad20-6019124f5537 tempest-GroupsTest-255372762 None] Group tempest-GroupsTest-Group-284321739: created successfully
Apr 24 19:54:10 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-670691d9-2234-40b6-ad20-6019124f5537 tempest-GroupsTest-255372762 None] Create group completed successfully.
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Flow 'volume_create_manager' (083fed64-b459-46f5-81f6-e59d2f20da2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d542e8d-3e84-460e-b289-0388eac873d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d542e8d-3e84-460e-b289-0388eac873d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-247649418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2f9c444a-4892-4fb9-9247-5577e9fadd06,host='devstack@QuobyteHD#QuobyteHD',id=fca46b82-1079-4bcd-a145-84eb91d3074e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3392eda644437999255b56273aac15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:12Z,use_quota=True,user_id='23bfe239a9d546478177ae7b02207ede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f68b0c5d-b871-4922-835b-12beaf788f50),volume_type_id=f68b0c5d-b871-4922-835b-12beaf788f50)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae0f81f-a46e-4b02-b509-98724ed13357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae0f81f-a46e-4b02-b509-98724ed13357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81807079-587c-48c7-b6a0-73d3b99bac3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81807079-587c-48c7-b6a0-73d3b99bac3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fca46b82-1079-4bcd-a145-84eb91d3074e', 'volume_name': 'volume-fca46b82-1079-4bcd-a145-84eb91d3074e', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843caa51-0262-4f61-9534-823f4f047362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843caa51-0262-4f61-9534-823f4f047362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f259ff5-0923-4ea9-8d49-356d1fea5f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:11 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Volume fca46b82-1079-4bcd-a145-84eb91d3074e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fca46b82-1079-4bcd-a145-84eb91d3074e', 'volume_size': 1}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2f9c444a-4892-4fb9-9247-5577e9fadd06,created_at=2026-04-24T17:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-247649418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2f9c444a-4892-4fb9-9247-5577e9fadd06,host='devstack@QuobyteHD#QuobyteHD',id=fca46b82-1079-4bcd-a145-84eb91d3074e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3392eda644437999255b56273aac15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:12Z,use_quota=True,user_id='23bfe239a9d546478177ae7b02207ede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f68b0c5d-b871-4922-835b-12beaf788f50),volume_type_id=f68b0c5d-b871-4922-835b-12beaf788f50)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Creating volume fca46b82-1079-4bcd-a145-84eb91d3074e {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:54:11 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:54:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fca46b82-1079-4bcd-a145-84eb91d3074e 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:11 devstack sudo[82874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fca46b82-1079-4bcd-a145-84eb91d3074e 1073741824
Apr 24 19:54:11 devstack sudo[82874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:12 devstack sudo[82874]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fca46b82-1079-4bcd-a145-84eb91d3074e 1073741824" returned: 0 in 1.165s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fca46b82-1079-4bcd-a145-84eb91d3074e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:13 devstack sudo[82885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fca46b82-1079-4bcd-a145-84eb91d3074e
Apr 24 19:54:13 devstack sudo[82885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:13 devstack sudo[82885]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fca46b82-1079-4bcd-a145-84eb91d3074e" returned: 0 in 0.733s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:54:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f259ff5-0923-4ea9-8d49-356d1fea5f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fca46b82-1079-4bcd-a145-84eb91d3074e', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0247a2-5b03-4ccf-8e7a-8b16397b02e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:13 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Volume volume-fca46b82-1079-4bcd-a145-84eb91d3074e (fca46b82-1079-4bcd-a145-84eb91d3074e): created successfully
Apr 24 19:54:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0247a2-5b03-4ccf-8e7a-8b16397b02e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Flow 'volume_create_manager' (083fed64-b459-46f5-81f6-e59d2f20da2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:54:13 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0f0f0f0c-0ddc-4d52-8b91-693249376b6d tempest-GroupsTest-255372762 None] Created volume successfully.
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Flow 'volume_create_manager' (3de8059f-a481-4d30-8564-5d081990ee82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02622b44-3285-40f8-af96-6f111e67f09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02622b44-3285-40f8-af96-6f111e67f09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1590648450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2f9c444a-4892-4fb9-9247-5577e9fadd06,host='devstack@QuobyteHD#QuobyteHD',id=41af5074-20d1-4b2a-b0fb-5ea3ce0e8816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3392eda644437999255b56273aac15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:14Z,use_quota=True,user_id='23bfe239a9d546478177ae7b02207ede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f68b0c5d-b871-4922-835b-12beaf788f50),volume_type_id=f68b0c5d-b871-4922-835b-12beaf788f50)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ef503d-6cf5-4ae5-ab35-e34a8c805bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ef503d-6cf5-4ae5-ab35-e34a8c805bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9d2f29-0ee8-4d49-9ff0-e4413045c8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9d2f29-0ee8-4d49-9ff0-e4413045c8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41af5074-20d1-4b2a-b0fb-5ea3ce0e8816', 'volume_name': 'volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1a6c95-13c9-4580-b83e-d363082e9e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1a6c95-13c9-4580-b83e-d363082e9e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306b4df2-2828-4a0c-9198-57bd5f0a4ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:14 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Volume 41af5074-20d1-4b2a-b0fb-5ea3ce0e8816: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816', 'volume_size': 1}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2f9c444a-4892-4fb9-9247-5577e9fadd06,created_at=2026-04-24T17:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1590648450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2f9c444a-4892-4fb9-9247-5577e9fadd06,host='devstack@QuobyteHD#QuobyteHD',id=41af5074-20d1-4b2a-b0fb-5ea3ce0e8816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3392eda644437999255b56273aac15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:14Z,use_quota=True,user_id='23bfe239a9d546478177ae7b02207ede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f68b0c5d-b871-4922-835b-12beaf788f50),volume_type_id=f68b0c5d-b871-4922-835b-12beaf788f50)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Creating volume 41af5074-20d1-4b2a-b0fb-5ea3ce0e8816 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:54:14 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:54:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:14 devstack sudo[82890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816 1073741824
Apr 24 19:54:14 devstack sudo[82890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:15 devstack sudo[82890]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816 1073741824" returned: 0 in 0.958s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:15 devstack sudo[82898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816
Apr 24 19:54:15 devstack sudo[82898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:16 devstack sudo[82898]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816" returned: 0 in 0.552s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:54:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306b4df2-2828-4a0c-9198-57bd5f0a4ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (570f0ad9-ffa2-4b02-9903-1405aeee80f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:16 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Volume volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816 (41af5074-20d1-4b2a-b0fb-5ea3ce0e8816): created successfully
Apr 24 19:54:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (570f0ad9-ffa2-4b02-9903-1405aeee80f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Flow 'volume_create_manager' (3de8059f-a481-4d30-8564-5d081990ee82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:54:16 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-71b3d6ed-5e01-4837-ab98-de3d0648bf36 tempest-GroupsTest-255372762 None] Created volume successfully.
Apr 24 19:54:16 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-66aacd41-4d87-41b8-90d1-6eb5df74b13f tempest-GroupsTest-255372762 None] Update group completed successfully.
Apr 24 19:54:18 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f440acd0-63d9-49c8-a409-29235dfa0554 tempest-GroupsTest-255372762 None] Update group completed successfully.
Apr 24 19:54:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Acquiring lock "cinder-quobyte-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:54:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Lock "cinder-quobyte-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816" acquired by "delete_volume" :: waited 0.041s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:54:20 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[401a5ae6-85a1-49ad-ba52-493da43a87b2]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:54:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:21 devstack sudo[83030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816
Apr 24 19:54:21 devstack sudo[83030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:21 devstack sudo[83030]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816" returned: 0 in 1.039s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:21 devstack sudo[83036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816
Apr 24 19:54:21 devstack sudo[83036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:22 devstack sudo[83036]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816" returned: 0 in 0.828s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Lock "cinder-quobyte-41af5074-20d1-4b2a-b0fb-5ea3ce0e8816" released by "delete_volume" :: held 1.976s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:54:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Acquiring lock "cinder-quobyte-fca46b82-1079-4bcd-a145-84eb91d3074e" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:54:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Lock "cinder-quobyte-fca46b82-1079-4bcd-a145-84eb91d3074e" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:54:22 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e0cbe6-3968-450f-81c1-d75aef38a4c1]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:54:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fca46b82-1079-4bcd-a145-84eb91d3074e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:22 devstack sudo[83044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fca46b82-1079-4bcd-a145-84eb91d3074e
Apr 24 19:54:22 devstack sudo[83044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 19:54:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:54:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:54:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:24 devstack sudo[83047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:54:24 devstack sudo[83047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:24 devstack sudo[83044]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fca46b82-1079-4bcd-a145-84eb91d3074e" returned: 0 in 1.548s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fca46b82-1079-4bcd-a145-84eb91d3074e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:24 devstack sudo[83051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fca46b82-1079-4bcd-a145-84eb91d3074e
Apr 24 19:54:24 devstack sudo[83051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:25 devstack sudo[83051]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fca46b82-1079-4bcd-a145-84eb91d3074e" returned: 0 in 1.085s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Lock "cinder-quobyte-fca46b82-1079-4bcd-a145-84eb91d3074e" released by "delete_volume" :: held 2.697s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:54:25 devstack sudo[83047]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.481s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:25 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:54:25 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Created reservations ['ddede197-4f9a-47b4-8752-1f719d0c83d9'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:54:25 devstack cinder-volume[81241]: WARNING cinder.quota [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1435383130 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1435383130, it is now deprecated. Please use the default quota class for default quota.
Apr 24 19:54:25 devstack cinder-volume[81241]: WARNING cinder.quota [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1435383130 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1435383130, it is now deprecated. Please use the default quota class for default quota.
Apr 24 19:54:25 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Created reservations ['53cc019e-2966-443a-97cf-030dae1d688e', 'ed0b9842-7c4e-400c-8b7e-16a0418779e8', 'c425c331-9b15-4e2c-bd05-62a0d2d227b4', 'cf9a7547-5ef5-406d-aaaf-0f91c0103749'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:54:25 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Created reservations ['f9eb17b6-0595-4423-ba47-8b65fafe88dc', 'f7b7d880-34c3-459a-bdb9-d089fe2abd87', 'a2778417-2bcd-4a57-86c6-927efa74c5da', '6b72240b-ed17-4689-833b-5b6d3044303c'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:54:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:54:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:54:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:26 devstack sudo[83056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:54:26 devstack sudo[83056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:28 devstack sudo[83056]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 2.167s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:28 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:54:28 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8bef91c5-9d1b-4893-9ba9-809b8853f956 tempest-GroupsTest-255372762 None] Delete group completed successfully.
Apr 24 19:54:36 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:UPDATE=48,cinder:SELECT=48,cinder:INSERT=13,cinder:DELETE=1 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:54:36 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=53,cinder:UPDATE=66,cinder:INSERT=10,cinder:DELETE=4 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Flow 'volume_create_manager' (81b88fa4-9bc9-455f-b5f9-ee48a5de4571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f189c76-eef6-4063-8783-2f382f3dfca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f189c76-eef6-4063-8783-2f382f3dfca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1765047115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c598c47-1c38-4ca1-948e-a3a7c87de97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5fb86e1eb44a7fad776241236ac3fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:39Z,use_quota=True,user_id='36603b23a774426f8c74c6dd0f3551f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8d31c7-b4cd-463f-acc8-e984b713db07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8d31c7-b4cd-463f-acc8-e984b713db07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33044448-bffd-430d-afc7-6a2e32a23702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33044448-bffd-430d-afc7-6a2e32a23702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c598c47-1c38-4ca1-948e-a3a7c87de97c', 'volume_name': 'volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cc981a-53d0-4731-b894-3d40a73c09c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cc981a-53d0-4731-b894-3d40a73c09c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcee33c7-a791-4379-a9ae-7695f3fc4b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:38 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Volume 7c598c47-1c38-4ca1-948e-a3a7c87de97c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c', 'volume_size': 1}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1765047115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c598c47-1c38-4ca1-948e-a3a7c87de97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5fb86e1eb44a7fad776241236ac3fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:39Z,use_quota=True,user_id='36603b23a774426f8c74c6dd0f3551f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Creating volume 7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:54:38 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:54:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:38 devstack sudo[83207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c 1073741824
Apr 24 19:54:38 devstack sudo[83207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:39 devstack sudo[83207]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c 1073741824" returned: 0 in 0.664s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:39 devstack sudo[83213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c
Apr 24 19:54:39 devstack sudo[83213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:40 devstack sudo[83213]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c" returned: 0 in 0.502s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:40 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:54:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcee33c7-a791-4379-a9ae-7695f3fc4b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c73cbb95-36e1-421f-bbee-187b2677de1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:40 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Volume volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c (7c598c47-1c38-4ca1-948e-a3a7c87de97c): created successfully
Apr 24 19:54:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c73cbb95-36e1-421f-bbee-187b2677de1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Flow 'volume_create_manager' (81b88fa4-9bc9-455f-b5f9-ee48a5de4571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:54:40 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8f053f34-f36c-41bd-8798-66096197b731 tempest-SnapshotsActionsTest-1276737476 None] Created volume successfully.
Apr 24 19:54:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] Creating offline snapshot 7bc139c0-50e7-4e81-b803-e82e85757e95 of volume 7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 19:54:41 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a0f276-e917-4be9-8640-752ff2dc614f]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:54:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:41 devstack sudo[83224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c
Apr 24 19:54:41 devstack sudo[83224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:42 devstack sudo[83224]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c" returned: 0 in 0.956s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:42 devstack sudo[83229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 1G
Apr 24 19:54:42 devstack sudo[83229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:43 devstack sudo[83229]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 1G" returned: 0 in 1.562s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:43 devstack sudo[83249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95
Apr 24 19:54:43 devstack sudo[83249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:45 devstack sudo[83249]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95" returned: 0 in 1.503s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:45 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 is being set with open permissions: ugo+rw
Apr 24 19:54:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:45 devstack sudo[83287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95
Apr 24 19:54:45 devstack sudo[83287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:47 devstack sudo[83287]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95" returned: 0 in 2.304s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:47 devstack sudo[83295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.info
Apr 24 19:54:47 devstack sudo[83295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:49 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:54:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Flow 'volume_create_manager' (7aaa5454-68a5-4229-8740-aefa4185b7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:54:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157d0a0c-ae97-42a1-b960-6fb129bd963a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157d0a0c-ae97-42a1-b960-6fb129bd963a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1795952695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=696c5b76-4343-43b8-9a31-0ab8457c7bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bac29e3406549a6911137ca1021cce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:49Z,use_quota=True,user_id='001878abbb4d412987bbccc9482d9f4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece76dbc-7952-46cb-9264-62966aeeec63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece76dbc-7952-46cb-9264-62966aeeec63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c223fe0-a6f7-4eaa-afb5-9e3fc7bead04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c223fe0-a6f7-4eaa-afb5-9e3fc7bead04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '696c5b76-4343-43b8-9a31-0ab8457c7bb8', 'volume_name': 'volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b093cdb3-62c9-4dbe-b21f-55496f6defd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b093cdb3-62c9-4dbe-b21f-55496f6defd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d1455f-ae51-43f7-9821-49940e16d0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:49 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Volume 696c5b76-4343-43b8-9a31-0ab8457c7bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8', 'volume_size': 1}
Apr 24 19:54:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:49 devstack sudo[83295]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.info" returned: 0 in 1.648s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:49 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.info is being set with open permissions: ugo+rw
Apr 24 19:54:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:49 devstack sudo[83301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.info
Apr 24 19:54:49 devstack sudo[83301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:50 devstack sudo[83301]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.info" returned: 0 in 1.062s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.217s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1795952695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=696c5b76-4343-43b8-9a31-0ab8457c7bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bac29e3406549a6911137ca1021cce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:49Z,use_quota=True,user_id='001878abbb4d412987bbccc9482d9f4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:54:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Creating volume 696c5b76-4343-43b8-9a31-0ab8457c7bb8 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:54:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:54:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:54:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:54:50 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:54:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:50 devstack sudo[83318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8 1073741824
Apr 24 19:54:50 devstack sudo[83318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:50 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-cca58a42-3802-4503-b4d2-01567b4af0eb tempest-SnapshotsActionsTest-1276737476 None] Create snapshot completed successfully
Apr 24 19:54:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:54:52 devstack sudo[83318]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8 1073741824" returned: 0 in 2.260s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:52 devstack sudo[83344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8
Apr 24 19:54:52 devstack sudo[83344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:54 devstack sudo[83344]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8" returned: 0 in 1.468s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] <== create_volume: return (3808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:54:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.817s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.636s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:54:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] Creating offline snapshot ebd4629e-0b78-4a3f-b202-e210dddda01b of volume 7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 19:54:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d1455f-ae51-43f7-9821-49940e16d0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad206cfb-1439-4e04-b90d-67aeacba6149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:54:54 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00980b9-ac44-4da1-a300-20c8d3af2fb5]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:54:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:54 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Volume volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8 (696c5b76-4343-43b8-9a31-0ab8457c7bb8): created successfully
Apr 24 19:54:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad206cfb-1439-4e04-b90d-67aeacba6149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:54:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Flow 'volume_create_manager' (7aaa5454-68a5-4229-8740-aefa4185b7ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:54:54 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-6eb88272-56b7-4223-9a8b-3edc78eb8af5 tempest-ServerRescueNegativeTestJSON-1474268857 None] Created volume successfully.
Apr 24 19:54:54 devstack sudo[83393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95
Apr 24 19:54:54 devstack sudo[83393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:55 devstack sudo[83393]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95" returned: 0 in 1.215s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:54:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:55 devstack sudo[83403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b 1G
Apr 24 19:54:55 devstack sudo[83403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:56 devstack sudo[83403]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b 1G" returned: 0 in 1.272s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:57 devstack sudo[83410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b
Apr 24 19:54:57 devstack sudo[83410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:57 devstack sudo[83410]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b" returned: 0 in 0.745s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:57 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b is being set with open permissions: ugo+rw
Apr 24 19:54:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:57 devstack sudo[83416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b
Apr 24 19:54:57 devstack sudo[83416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:54:58 devstack sudo[83416]: pam_unix(sudo:session): session closed for user root
Apr 24 19:54:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b" returned: 0 in 0.576s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:54:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.989s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:54:58 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f25b318b-7bcb-4709-9770-d3af69236f01 tempest-SnapshotsActionsTest-1276737476 None] Create snapshot completed successfully
Apr 24 19:54:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Acquiring lock "cinder-ebd4629e-0b78-4a3f-b202-e210dddda01b-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:54:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-ebd4629e-0b78-4a3f-b202-e210dddda01b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:54:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Acquiring lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:54:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" acquired by "delete_snapshot" :: waited 0.057s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:54:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Acquiring lock "cinder-quobyte-ebd4629e-0b78-4a3f-b202-e210dddda01b" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:54:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-ebd4629e-0b78-4a3f-b202-e210dddda01b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:54:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Deleting offline snapshot ebd4629e-0b78-4a3f-b202-e210dddda01b of volume 7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 19:54:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] snapshot_file for this snap is: volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 19:54:59 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecea31b-e8c5-4717-aed4-7bd50e6d143d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:54:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:54:59 devstack sudo[83427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b
Apr 24 19:54:59 devstack sudo[83427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:00 devstack sudo[83427]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b" returned: 0 in 1.265s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:00 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:55:00 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[801ecfec-ab97-4624-9e22-bbab93ee4ced]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:00 devstack sudo[83457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95
Apr 24 19:55:00 devstack sudo[83457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:01 devstack sudo[83457]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95" returned: 0 in 1.204s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:01 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:55:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:01 devstack sudo[83477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b
Apr 24 19:55:01 devstack sudo[83477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:02 devstack sudo[83477]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b" returned: 0 in 1.048s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:02 devstack sudo[83518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b
Apr 24 19:55:02 devstack sudo[83518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:03 devstack sudo[83518]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.ebd4629e-0b78-4a3f-b202-e210dddda01b" returned: 0 in 0.633s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-ebd4629e-0b78-4a3f-b202-e210dddda01b" released by "_delete_snapshot" :: held 4.275s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" released by "delete_snapshot" :: held 4.319s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:03 devstack cinder-volume[81241]: WARNING cinder.quota [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 24 19:55:03 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Created reservations ['29f9dbf0-2339-4110-afcb-4b3191822fe9', '576a8044-1f2d-4c38-9dd1-6334f6904360', 'efcd0984-65ba-4c43-99d2-6d80c4a98dc5', '225b8b27-0457-4083-b40d-e89b304261c0'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:55:03 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Delete snapshot completed successfully.
Apr 24 19:55:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3f633d9b-34d0-4bab-84ed-aeb13f3494de tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-ebd4629e-0b78-4a3f-b202-e210dddda01b-delete_snapshot" released by "delete_snapshot" :: held 4.597s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] Creating offline snapshot 65ae5021-886f-4cf8-9075-869953111eb2 of volume 7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 19:55:05 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85af2b8-9cf9-4a2d-a0c4-4e20cc228d01]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:05 devstack sudo[83676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95
Apr 24 19:55:05 devstack sudo[83676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:05 devstack sudo[83676]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95" returned: 0 in 0.655s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:55:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:05 devstack sudo[83689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2 1G
Apr 24 19:55:05 devstack sudo[83689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:06 devstack sudo[83689]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2 1G" returned: 0 in 0.997s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:06 devstack sudo[83723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2
Apr 24 19:55:06 devstack sudo[83723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:07 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:55:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Flow 'volume_create_manager' (aebe8c77-423b-4404-a9b9-5d83f053cde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:55:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d502558-fefe-483f-8e4e-e3bc402450ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d502558-fefe-483f-8e4e-e3bc402450ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:55:07Z,deleted=False,deleted_at=None,display_description='',display_name='f220f9a2-7798-4d94-830f-b8e3538cbbcc-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8a5f02-cc9f-422e-b26b-84ea0260d7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7076d4b273b94478a8b0caa2b6e338f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:08Z,use_quota=True,user_id='509d147b94704c9cb3c8e99ea2b69578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b43af3-c9f2-429c-98d0-9580230f7084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b43af3-c9f2-429c-98d0-9580230f7084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62284b7-8fc0-4870-b44e-faa5489d358b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62284b7-8fc0-4870-b44e-faa5489d358b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8a5f02-cc9f-422e-b26b-84ea0260d7cc', 'volume_name': 'volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6adb28-cb32-4d38-80ef-fa6314946118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6adb28-cb32-4d38-80ef-fa6314946118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1199f855-5ad1-4060-8177-c8d1bc207e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:07 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Volume 2b8a5f02-cc9f-422e-b26b-84ea0260d7cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc', 'volume_size': 1}
Apr 24 19:55:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:08 devstack sudo[83723]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2" returned: 0 in 1.373s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:08 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2 is being set with open permissions: ugo+rw
Apr 24 19:55:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:08 devstack sudo[83740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2
Apr 24 19:55:08 devstack sudo[83740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:08 devstack sudo[83740]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2" returned: 0 in 0.731s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.892s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.957s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:55:07Z,deleted=False,deleted_at=None,display_description='',display_name='f220f9a2-7798-4d94-830f-b8e3538cbbcc-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8a5f02-cc9f-422e-b26b-84ea0260d7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7076d4b273b94478a8b0caa2b6e338f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:08Z,use_quota=True,user_id='509d147b94704c9cb3c8e99ea2b69578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:55:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Creating volume 2b8a5f02-cc9f-422e-b26b-84ea0260d7cc {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:55:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:55:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:55:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:55:08 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:55:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:09 devstack sudo[83745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc 1073741824
Apr 24 19:55:09 devstack sudo[83745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:09 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-50f2240c-0588-4c1a-a844-46c356d6eca7 tempest-SnapshotsActionsTest-1276737476 None] Create snapshot completed successfully
Apr 24 19:55:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Acquiring lock "cinder-65ae5021-886f-4cf8-9075-869953111eb2-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-65ae5021-886f-4cf8-9075-869953111eb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Acquiring lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" acquired by "delete_snapshot" :: waited 0.067s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Acquiring lock "cinder-quobyte-65ae5021-886f-4cf8-9075-869953111eb2" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-65ae5021-886f-4cf8-9075-869953111eb2" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Deleting offline snapshot 65ae5021-886f-4cf8-9075-869953111eb2 of volume 7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 19:55:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] snapshot_file for this snap is: volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 19:55:09 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfd3cf3-fac7-4660-94da-db95dc19c9ab]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:10 devstack sudo[83759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2
Apr 24 19:55:10 devstack sudo[83759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:10 devstack sudo[83745]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc 1073741824" returned: 0 in 1.697s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:10 devstack sudo[83823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc
Apr 24 19:55:10 devstack sudo[83823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:11 devstack sudo[83759]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2" returned: 0 in 1.535s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:11 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:55:11 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[849af3cd-8e49-4209-8276-3d412f222e7c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:11 devstack sudo[83884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95
Apr 24 19:55:11 devstack sudo[83884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:12 devstack sudo[83823]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc" returned: 0 in 1.474s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] <== create_volume: return (3368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:55:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.370s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1199f855-5ad1-4060-8177-c8d1bc207e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1953f8a-c9e8-4239-bc18-7481a2535fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:12 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Volume volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc (2b8a5f02-cc9f-422e-b26b-84ea0260d7cc): created successfully
Apr 24 19:55:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1953f8a-c9e8-4239-bc18-7481a2535fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Flow 'volume_create_manager' (aebe8c77-423b-4404-a9b9-5d83f053cde6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:55:12 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-580adb8e-25b5-4ebc-818f-c6a7b0fe7d21 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Created volume successfully.
Apr 24 19:55:12 devstack sudo[83884]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95" returned: 0 in 1.316s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:55:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:12 devstack sudo[83906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2
Apr 24 19:55:12 devstack sudo[83906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:14 devstack sudo[83906]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2" returned: 0 in 1.412s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:14 devstack sudo[83957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2
Apr 24 19:55:14 devstack sudo[83957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-343bbb0f-4ce5-428f-be91-d83cbe460c26 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-343bbb0f-4ce5-428f-be91-d83cbe460c26 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:15 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb782d2-adc2-42f6-9fd8-1366128d2eb3]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-343bbb0f-4ce5-428f-be91-d83cbe460c26 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:15 devstack sudo[83991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc
Apr 24 19:55:15 devstack sudo[83991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:15 devstack sudo[83957]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.65ae5021-886f-4cf8-9075-869953111eb2" returned: 0 in 1.567s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-65ae5021-886f-4cf8-9075-869953111eb2" released by "_delete_snapshot" :: held 6.026s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" released by "delete_snapshot" :: held 6.114s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:15 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:55:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Flow 'volume_create_manager' (7868d3c7-5d4d-4378-a4c5-57cc90f7ef57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:55:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50342b62-b6c2-49f2-9a0f-9b5f21fcb08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50342b62-b6c2-49f2-9a0f-9b5f21fcb08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1507068807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ce3173ad44488b82dcae63850a42d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:16Z,use_quota=True,user_id='d9099e0470954a2790796acdf16b1511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d0555e-b217-48ec-a051-685d7dd0e111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d0555e-b217-48ec-a051-685d7dd0e111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f321e60-4499-4364-b11f-e5763242d852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f321e60-4499-4364-b11f-e5763242d852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e', 'volume_name': 'volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6cf882d-479d-4792-806a-c78bf6382d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6cf882d-479d-4792-806a-c78bf6382d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aafec3a-e57d-460b-bb78-bece335d8a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:16 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Volume 3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e', 'volume_size': 1}
Apr 24 19:55:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:16 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Created reservations ['7dc7d335-9801-45a8-9018-a2db62bddb63', '5389290b-b06c-4de0-ac69-968d361a2400', '1491de11-d959-4f08-b929-cae5aaba2986', '2d40e252-8109-46c6-8748-6bea801bb640'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:55:16 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Delete snapshot completed successfully.
Apr 24 19:55:16 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5f687c7f-ba31-4fc6-8891-d87d03c130ec tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-65ae5021-886f-4cf8-9075-869953111eb2-delete_snapshot" released by "delete_snapshot" :: held 6.580s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:17 devstack sudo[83991]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-343bbb0f-4ce5-428f-be91-d83cbe460c26 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc" returned: 0 in 1.638s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-343bbb0f-4ce5-428f-be91-d83cbe460c26 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.695s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.028s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:17 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1507068807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ce3173ad44488b82dcae63850a42d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:16Z,use_quota=True,user_id='d9099e0470954a2790796acdf16b1511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:55:17 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Creating volume 3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:55:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:17 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:55:17 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:55:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:17 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:55:17 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:55:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:17 devstack sudo[84026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e 1073741824
Apr 24 19:55:17 devstack sudo[84026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-343bbb0f-4ce5-428f-be91-d83cbe460c26 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e', 'name': 'volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fd00921-b6e9-490a-8326-490b87104479', 'enforce_multipath': True} {{(pid=81241) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 24 19:55:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:17 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-39993fdf-07cf-4d94-b9a1-8411711d60e9 req-343bbb0f-4ce5-428f-be91-d83cbe460c26 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] attachment_update completed successfully.
Apr 24 19:55:18 devstack sudo[84026]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e 1073741824" returned: 0 in 1.596s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:18 devstack sudo[84039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e
Apr 24 19:55:18 devstack sudo[84039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Acquiring lock "cinder-696c5b76-4343-43b8-9a31-0ab8457c7bb8-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Lock "cinder-696c5b76-4343-43b8-9a31-0ab8457c7bb8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Acquiring lock "cinder-quobyte-696c5b76-4343-43b8-9a31-0ab8457c7bb8" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Lock "cinder-quobyte-696c5b76-4343-43b8-9a31-0ab8457c7bb8" acquired by "delete_volume" :: waited 0.046s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:19 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0fb901-611a-4d94-b2a4-efc0b6463d74]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:19 devstack sudo[84043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8
Apr 24 19:55:19 devstack sudo[84043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:19 devstack sudo[84039]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e" returned: 0 in 1.137s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] <== create_volume: return (2795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:55:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.800s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.127s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] Creating offline snapshot 4aeae95d-361e-4e33-a4e9-c1f1df3411a5 of volume 7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aafec3a-e57d-460b-bb78-bece335d8a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9265b73-44a2-478f-a5cd-a6105c5da0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ccec8c-98b8-4319-8782-6707a216c7e2]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:20 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Volume volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e (3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e): created successfully
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9265b73-44a2-478f-a5cd-a6105c5da0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Flow 'volume_create_manager' (7868d3c7-5d4d-4378-a4c5-57cc90f7ef57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:55:20 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b9f39d6b-c1ee-4246-8dd3-33565e18f639 tempest-VolumesActionsTest-1762206869 None] Created volume successfully.
Apr 24 19:55:20 devstack sudo[84043]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8" returned: 0 in 0.894s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:20 devstack sudo[84116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95
Apr 24 19:55:20 devstack sudo[84116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:20 devstack sudo[84117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8
Apr 24 19:55:20 devstack sudo[84117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:20 devstack sudo[84117]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-696c5b76-4343-43b8-9a31-0ab8457c7bb8" returned: 0 in 0.506s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Lock "cinder-quobyte-696c5b76-4343-43b8-9a31-0ab8457c7bb8" released by "delete_volume" :: held 1.454s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Created reservations ['adb6c1bb-03c3-4e0f-a30f-1c3074bfaef0', '54f4c63a-2dfa-4b18-be51-e844a6eb73c0', 'ca0df957-18b6-4e20-af9e-532c5773d666', 'c0857b8b-ab16-4165-bc58-337b8cf1744b'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:55:20 devstack sudo[84116]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95" returned: 0 in 0.754s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:55:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:20 devstack sudo[84124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5 1G
Apr 24 19:55:20 devstack sudo[84124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:21 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:55:21 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:55:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:21 devstack sudo[84126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:55:21 devstack sudo[84126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:21 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8a0aac5e-e582-4665-9b26-7269caa77862 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "cinder-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e" by "attach_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:21 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8a0aac5e-e582-4665-9b26-7269caa77862 tempest-VolumesActionsTest-1762206869 None] Lock "cinder-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e" acquired by "attach_volume" :: waited 0.032s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:21 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8a0aac5e-e582-4665-9b26-7269caa77862 tempest-VolumesActionsTest-1762206869 None] Attaching volume 3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e to instance d5990232-7891-4156-b874-728091aeee84 at mountpoint /dev/vdb on host None.
Apr 24 19:55:21 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8a0aac5e-e582-4665-9b26-7269caa77862 tempest-VolumesActionsTest-1762206869 None] Attach volume completed successfully.
Apr 24 19:55:21 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8a0aac5e-e582-4665-9b26-7269caa77862 tempest-VolumesActionsTest-1762206869 None] Lock "cinder-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e" released by "attach_volume" :: held 0.282s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:22 devstack sudo[84126]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.239s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:22 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:55:22 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Deleted volume successfully.
Apr 24 19:55:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0292445d-eaf8-4674-8965-815d79ee0a38 tempest-ServerRescueNegativeTestJSON-1474268857 None] Lock "cinder-696c5b76-4343-43b8-9a31-0ab8457c7bb8-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:22 devstack sudo[84124]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5 1G" returned: 0 in 1.359s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:22 devstack sudo[84139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5
Apr 24 19:55:22 devstack sudo[84139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:22 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-25da775d-2cec-4798-9f23-dfc79627cb15 tempest-VolumesActionsTest-584604081 None] Terminate volume connection completed successfully.
Apr 24 19:55:23 devstack sudo[84139]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5" returned: 0 in 0.874s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:23 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5 is being set with open permissions: ugo+rw
Apr 24 19:55:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:23 devstack sudo[84467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5
Apr 24 19:55:23 devstack sudo[84467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:23 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-25da775d-2cec-4798-9f23-dfc79627cb15 tempest-VolumesActionsTest-584604081 None] Acquiring lock "cinder-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e-detach_volume" by "detach_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:23 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-25da775d-2cec-4798-9f23-dfc79627cb15 tempest-VolumesActionsTest-584604081 None] Lock "cinder-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e-detach_volume" acquired by "detach_volume" :: waited 0.143s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:23 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-25da775d-2cec-4798-9f23-dfc79627cb15 tempest-VolumesActionsTest-584604081 None] Detaching volume 3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e from instance d5990232-7891-4156-b874-728091aeee84.
Apr 24 19:55:23 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-25da775d-2cec-4798-9f23-dfc79627cb15 tempest-VolumesActionsTest-584604081 None] Detach volume completed successfully.
Apr 24 19:55:23 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-25da775d-2cec-4798-9f23-dfc79627cb15 tempest-VolumesActionsTest-584604081 None] Lock "cinder-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e-detach_volume" released by "detach_volume" :: held 0.205s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 19:55:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:55:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:55:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:24 devstack sudo[84494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:55:24 devstack sudo[84494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d3aaf71d-9d58-4467-ba90-163ad0d7a638 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "cinder-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e-detach_volume" by "detach_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d3aaf71d-9d58-4467-ba90-163ad0d7a638 tempest-VolumesActionsTest-1762206869 None] Lock "cinder-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e-detach_volume" acquired by "detach_volume" :: waited 0.077s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:24 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d3aaf71d-9d58-4467-ba90-163ad0d7a638 tempest-VolumesActionsTest-1762206869 None] Volume detach called, but volume not attached.
Apr 24 19:55:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d3aaf71d-9d58-4467-ba90-163ad0d7a638 tempest-VolumesActionsTest-1762206869 None] Lock "cinder-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:24 devstack sudo[84467]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5" returned: 0 in 1.428s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.871s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:24 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b95e4336-66e1-446a-8768-cc67dc4e928a tempest-SnapshotsActionsTest-1276737476 None] Create snapshot completed successfully
Apr 24 19:55:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "cinder-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Lock "cinder-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "cinder-quobyte-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Lock "cinder-quobyte-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e" acquired by "delete_volume" :: waited 0.067s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9885c7-bcc0-4818-955d-ee02cb3b7fd0]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:26 devstack sudo[84494]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Acquiring lock "cinder-4aeae95d-361e-4e33-a4e9-c1f1df3411a5-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 2.348s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-4aeae95d-361e-4e33-a4e9-c1f1df3411a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Acquiring lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Acquiring lock "cinder-quobyte-4aeae95d-361e-4e33-a4e9-c1f1df3411a5" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:26 devstack sudo[84601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e
Apr 24 19:55:26 devstack sudo[84601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-4aeae95d-361e-4e33-a4e9-c1f1df3411a5" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Deleting offline snapshot 4aeae95d-361e-4e33-a4e9-c1f1df3411a5 of volume 7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] snapshot_file for this snap is: volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8d01d9-9519-4f5e-8771-6c3e66d7ac12]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:26 devstack sudo[84612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5
Apr 24 19:55:26 devstack sudo[84612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:28 devstack sudo[84612]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5" returned: 0 in 1.358s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:55:28 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e181e8-e372-4d0f-811a-159b6bd22345]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:28 devstack sudo[84601]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e" returned: 0 in 1.961s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:28 devstack sudo[84630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e
Apr 24 19:55:28 devstack sudo[84630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:28 devstack sudo[84628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95
Apr 24 19:55:28 devstack sudo[84628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:28 devstack sudo[84630]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e" returned: 0 in 0.710s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Lock "cinder-quobyte-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e" released by "delete_volume" :: held 2.836s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:29 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Created reservations ['2753e90d-f990-4feb-bda5-ab21d170a2a1', '6ec6a932-2830-4ea5-8cdf-619a851ea15f', '7970e96f-8c40-4337-b39e-35de7bb8f43a', '9935b767-b0f4-493a-b1de-8ce4838ad5c0'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:55:29 devstack sudo[84628]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95" returned: 0 in 1.095s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:55:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:29 devstack sudo[84641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5
Apr 24 19:55:29 devstack sudo[84641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:55:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:55:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:29 devstack sudo[84643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:55:29 devstack sudo[84643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:30 devstack sudo[84643]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.697s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:30 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:55:30 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Deleted volume successfully.
Apr 24 19:55:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e45197ad-64cb-4751-98c3-fd662d8d0971 tempest-VolumesActionsTest-1762206869 None] Lock "cinder-3eb9fbd7-a8db-46d9-a10c-66d9f059ab0e-delete_volume" released by "delete_volume" :: held 4.393s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:30 devstack sudo[84641]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5" returned: 0 in 1.041s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:30 devstack sudo[84649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5
Apr 24 19:55:30 devstack sudo[84649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:30 devstack sudo[84649]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.4aeae95d-361e-4e33-a4e9-c1f1df3411a5" returned: 0 in 0.619s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-4aeae95d-361e-4e33-a4e9-c1f1df3411a5" released by "_delete_snapshot" :: held 4.348s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" released by "delete_snapshot" :: held 4.410s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:31 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Created reservations ['18ebeacc-a687-4026-9fbe-37c175386148', '63bebc2c-10d2-43b4-8e35-3b5749330e65', 'e27c6d2f-6a73-4fee-bbff-8a5025ecbe25', 'd05acff0-3e28-464d-bcad-dd1ed18ae43c'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:55:31 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Delete snapshot completed successfully.
Apr 24 19:55:31 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3ecada9e-e19d-4169-a771-a8ba100a49fa tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-4aeae95d-361e-4e33-a4e9-c1f1df3411a5-delete_snapshot" released by "delete_snapshot" :: held 4.662s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] Creating offline snapshot 886bc699-14e1-4ac9-8919-92ddd26f042d of volume 7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 19:55:32 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[61be62af-44ff-49f8-b780-641f5e84e46d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:32 devstack sudo[84693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95
Apr 24 19:55:32 devstack sudo[84693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:33 devstack sudo[84693]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95" returned: 0 in 0.785s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:55:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:33 devstack sudo[84701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d 1G
Apr 24 19:55:33 devstack sudo[84701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:34 devstack sudo[84701]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d 1G" returned: 0 in 0.958s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:34 devstack sudo[84717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d
Apr 24 19:55:34 devstack sudo[84717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:35 devstack sudo[84717]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d" returned: 0 in 0.744s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:35 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d is being set with open permissions: ugo+rw
Apr 24 19:55:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:35 devstack sudo[84740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d
Apr 24 19:55:35 devstack sudo[84740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:35 devstack sudo[84740]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d" returned: 0 in 0.509s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.108s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:35 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-2a367b67-95c9-4068-9b58-e950dd431855 tempest-SnapshotsActionsTest-1276737476 None] Create snapshot completed successfully
Apr 24 19:55:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Acquiring lock "cinder-886bc699-14e1-4ac9-8919-92ddd26f042d-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-886bc699-14e1-4ac9-8919-92ddd26f042d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Acquiring lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Acquiring lock "cinder-quobyte-886bc699-14e1-4ac9-8919-92ddd26f042d" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-886bc699-14e1-4ac9-8919-92ddd26f042d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:36 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Deleting offline snapshot 886bc699-14e1-4ac9-8919-92ddd26f042d of volume 7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 19:55:36 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] snapshot_file for this snap is: volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 19:55:36 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f760dd40-7160-4eb6-b59e-34a4a0468e42]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:36 devstack sudo[84763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d
Apr 24 19:55:36 devstack sudo[84763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:37 devstack sudo[84763]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d" returned: 0 in 0.779s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5d9e20-f66b-44cc-b153-cccf2e35dd54]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:37 devstack sudo[84809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95
Apr 24 19:55:37 devstack sudo[84809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=58,cinder:UPDATE=56,cinder:INSERT=9,cinder:DELETE=2 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=59,cinder:UPDATE=55,cinder:INSERT=18,cinder:DELETE=9 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Flow 'volume_create_manager' (d817411e-0ed2-405b-bb5f-7b70b64e7413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf821bb-cb0f-4f25-922d-cdff08b8824e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf821bb-cb0f-4f25-922d-cdff08b8824e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-413348438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b3d644-4466-42c4-a745-91fcbaf85755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ce3173ad44488b82dcae63850a42d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:38Z,use_quota=True,user_id='d9099e0470954a2790796acdf16b1511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb2b8d5-0eaa-4880-b970-87421b6a5479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb2b8d5-0eaa-4880-b970-87421b6a5479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d05dee-d2ec-42a0-9eaa-20aa3cd7445b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d05dee-d2ec-42a0-9eaa-20aa3cd7445b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b3d644-4466-42c4-a745-91fcbaf85755', 'volume_name': 'volume-44b3d644-4466-42c4-a745-91fcbaf85755', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3f208b-0cda-484d-8bea-55f2f4777064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3f208b-0cda-484d-8bea-55f2f4777064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3e1f9e-eada-4a52-a319-cb123120a690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:37 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Volume 44b3d644-4466-42c4-a745-91fcbaf85755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b3d644-4466-42c4-a745-91fcbaf85755', 'volume_size': 1}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-413348438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b3d644-4466-42c4-a745-91fcbaf85755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ce3173ad44488b82dcae63850a42d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:38Z,use_quota=True,user_id='d9099e0470954a2790796acdf16b1511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Creating volume 44b3d644-4466-42c4-a745-91fcbaf85755 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:55:37 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:55:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44b3d644-4466-42c4-a745-91fcbaf85755 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:37 devstack sudo[84812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44b3d644-4466-42c4-a745-91fcbaf85755 1073741824
Apr 24 19:55:37 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:38 devstack sudo[84809]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95" returned: 0 in 0.770s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:55:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:38 devstack sudo[84820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d
Apr 24 19:55:38 devstack sudo[84820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:38 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44b3d644-4466-42c4-a745-91fcbaf85755 1073741824" returned: 0 in 0.793s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44b3d644-4466-42c4-a745-91fcbaf85755 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:38 devstack sudo[84827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44b3d644-4466-42c4-a745-91fcbaf85755
Apr 24 19:55:38 devstack sudo[84827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:39 devstack sudo[84820]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d" returned: 0 in 0.697s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:39 devstack sudo[84850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d
Apr 24 19:55:39 devstack sudo[84850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:39 devstack sudo[84827]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44b3d644-4466-42c4-a745-91fcbaf85755" returned: 0 in 0.542s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:55:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3e1f9e-eada-4a52-a319-cb123120a690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b3d644-4466-42c4-a745-91fcbaf85755', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bfc9e9-76c7-4e06-bf1f-316c13b348ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:39 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Volume volume-44b3d644-4466-42c4-a745-91fcbaf85755 (44b3d644-4466-42c4-a745-91fcbaf85755): created successfully
Apr 24 19:55:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bfc9e9-76c7-4e06-bf1f-316c13b348ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Flow 'volume_create_manager' (d817411e-0ed2-405b-bb5f-7b70b64e7413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:55:39 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c0a6a8b6-0929-42b6-a0c5-27070bf8bbe8 tempest-VolumesActionsTest-1762206869 None] Created volume successfully.
Apr 24 19:55:39 devstack sudo[84850]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.886bc699-14e1-4ac9-8919-92ddd26f042d" returned: 0 in 0.504s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-886bc699-14e1-4ac9-8919-92ddd26f042d" released by "_delete_snapshot" :: held 2.865s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" released by "delete_snapshot" :: held 2.898s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:39 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Created reservations ['3d85960c-4027-4a70-851d-fcbb1ba02992', 'c40fa634-f02c-4ddd-96cf-28cbd4e0b52a', '795b3966-6dd0-4f94-be80-6a03de9aeaf9', '6d21d7b6-f76d-4663-a3be-a3b62adbef55'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:55:39 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Delete snapshot completed successfully.
Apr 24 19:55:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-6762af06-a23d-471e-a1b4-d611ad39575f tempest-SnapshotsActionsTest-1237137383 None] Lock "cinder-886bc699-14e1-4ac9-8919-92ddd26f042d-delete_snapshot" released by "delete_snapshot" :: held 3.058s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Acquiring lock "cinder-44b3d644-4466-42c4-a745-91fcbaf85755-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Lock "cinder-44b3d644-4466-42c4-a745-91fcbaf85755-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Acquiring lock "cinder-quobyte-44b3d644-4466-42c4-a745-91fcbaf85755" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Lock "cinder-quobyte-44b3d644-4466-42c4-a745-91fcbaf85755" acquired by "delete_volume" :: waited 0.024s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[05be3b14-9999-4d8c-a841-2b5229e8298d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44b3d644-4466-42c4-a745-91fcbaf85755 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:40 devstack sudo[84881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44b3d644-4466-42c4-a745-91fcbaf85755
Apr 24 19:55:40 devstack sudo[84881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Acquiring lock "cinder-7bc139c0-50e7-4e81-b803-e82e85757e95-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Lock "cinder-7bc139c0-50e7-4e81-b803-e82e85757e95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Acquiring lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Acquiring lock "cinder-quobyte-7bc139c0-50e7-4e81-b803-e82e85757e95" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Lock "cinder-quobyte-7bc139c0-50e7-4e81-b803-e82e85757e95" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Deleting offline snapshot 7bc139c0-50e7-4e81-b803-e82e85757e95 of volume 7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] snapshot_file for this snap is: volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b388b7b6-beab-4666-9983-bf8eaa225902]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:40 devstack sudo[84883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95
Apr 24 19:55:40 devstack sudo[84883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:40 devstack sudo[84881]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44b3d644-4466-42c4-a745-91fcbaf85755" returned: 0 in 0.620s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44b3d644-4466-42c4-a745-91fcbaf85755 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:40 devstack sudo[84888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44b3d644-4466-42c4-a745-91fcbaf85755
Apr 24 19:55:40 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:41 devstack sudo[84883]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95" returned: 0 in 0.589s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[719b8ea8-2251-4259-b098-bd655c51963c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:41 devstack sudo[84893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c
Apr 24 19:55:41 devstack sudo[84893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:41 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44b3d644-4466-42c4-a745-91fcbaf85755" returned: 0 in 0.590s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Lock "cinder-quobyte-44b3d644-4466-42c4-a745-91fcbaf85755" released by "delete_volume" :: held 1.256s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Created reservations ['1470a2f5-6f0d-4d51-9a1a-be52897c579f', '29e7b764-e456-4a3e-8719-70cb6c87b8a9', '93f29be8-ad29-4c9c-81ae-7ad3c9300f4c', 'bb57d361-2843-46c5-86b2-fc77e763d0dc'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:41 devstack sudo[84896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:55:41 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c" returned: 0 in 0.678s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:41 devstack sudo[84893]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:41 devstack sudo[84903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95
Apr 24 19:55:41 devstack sudo[84903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:42 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.491s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:55:42 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Deleted volume successfully.
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9e0a6fd1-8dd9-4ede-ae00-e2df0c2c6ab2 tempest-VolumesActionsTest-584604081 None] Lock "cinder-44b3d644-4466-42c4-a745-91fcbaf85755-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:42 devstack sudo[84903]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95" returned: 0 in 0.709s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:42 devstack sudo[84910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95
Apr 24 19:55:42 devstack sudo[84910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Flow 'volume_create_manager' (f2b2fd80-a07b-4c94-9417-37f466dc48d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f51fdc1-9811-4842-8970-19dc56cad1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f51fdc1-9811-4842-8970-19dc56cad1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-847492667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6018153-b921-48ba-be9e-31968dd2e0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ce3173ad44488b82dcae63850a42d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:43Z,use_quota=True,user_id='d9099e0470954a2790796acdf16b1511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab665d14-b641-4980-962e-1fb5f2a6cc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab665d14-b641-4980-962e-1fb5f2a6cc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465915c5-49b2-4778-b3b0-1e73ae9ebfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465915c5-49b2-4778-b3b0-1e73ae9ebfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6018153-b921-48ba-be9e-31968dd2e0f6', 'volume_name': 'volume-f6018153-b921-48ba-be9e-31968dd2e0f6', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27d967a-7422-4e79-b277-172fb151f1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27d967a-7422-4e79-b277-172fb151f1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081797ad-d67c-4c0d-a70d-1fc61d48fcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:42 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Volume f6018153-b921-48ba-be9e-31968dd2e0f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6018153-b921-48ba-be9e-31968dd2e0f6', 'volume_size': 1}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-847492667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6018153-b921-48ba-be9e-31968dd2e0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ce3173ad44488b82dcae63850a42d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:43Z,use_quota=True,user_id='d9099e0470954a2790796acdf16b1511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Creating volume f6018153-b921-48ba-be9e-31968dd2e0f6 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:55:42 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:55:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6018153-b921-48ba-be9e-31968dd2e0f6 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:42 devstack sudo[84913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6018153-b921-48ba-be9e-31968dd2e0f6 1073741824
Apr 24 19:55:42 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:43 devstack sudo[84910]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c.7bc139c0-50e7-4e81-b803-e82e85757e95" returned: 0 in 0.558s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Lock "cinder-quobyte-7bc139c0-50e7-4e81-b803-e82e85757e95" released by "_delete_snapshot" :: held 2.680s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" released by "delete_snapshot" :: held 2.708s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:43 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Created reservations ['a693c945-86d6-4711-b631-703460be4d04', '4d706cbc-406a-4cc5-8aad-72e1833b867d', 'b329c468-a2df-491a-8495-872fb6877269', '74b80888-5af7-4d06-9a0f-ef5f9f7de68f'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:55:43 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Delete snapshot completed successfully.
Apr 24 19:55:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-338e62cd-551f-402c-8821-8d1feabfe45a tempest-SnapshotsActionsTest-1276737476 None] Lock "cinder-7bc139c0-50e7-4e81-b803-e82e85757e95-delete_snapshot" released by "delete_snapshot" :: held 2.940s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:43 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Acquiring lock "cinder-7c598c47-1c38-4ca1-948e-a3a7c87de97c-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6018153-b921-48ba-be9e-31968dd2e0f6 1073741824" returned: 0 in 0.916s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Lock "cinder-7c598c47-1c38-4ca1-948e-a3a7c87de97c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6018153-b921-48ba-be9e-31968dd2e0f6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Acquiring lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:44 devstack sudo[84924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6018153-b921-48ba-be9e-31968dd2e0f6
Apr 24 19:55:44 devstack sudo[84924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" acquired by "delete_volume" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:44 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[88117471-79e9-4468-aa20-7d4f8a106228]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:44 devstack sudo[84928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c
Apr 24 19:55:44 devstack sudo[84928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:44 devstack sudo[84924]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6018153-b921-48ba-be9e-31968dd2e0f6" returned: 0 in 0.630s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:55:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081797ad-d67c-4c0d-a70d-1fc61d48fcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6018153-b921-48ba-be9e-31968dd2e0f6', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56153b2-b157-4da7-9de5-130de034ba7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:44 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Volume volume-f6018153-b921-48ba-be9e-31968dd2e0f6 (f6018153-b921-48ba-be9e-31968dd2e0f6): created successfully
Apr 24 19:55:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56153b2-b157-4da7-9de5-130de034ba7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Flow 'volume_create_manager' (f2b2fd80-a07b-4c94-9417-37f466dc48d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:55:44 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a66fde80-4d78-4600-9c6e-365d2f05baf8 tempest-VolumesActionsTest-1762206869 None] Created volume successfully.
Apr 24 19:55:44 devstack sudo[84928]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c" returned: 0 in 0.644s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:44 devstack sudo[84940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c
Apr 24 19:55:44 devstack sudo[84940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Acquiring lock "cinder-f6018153-b921-48ba-be9e-31968dd2e0f6-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Lock "cinder-f6018153-b921-48ba-be9e-31968dd2e0f6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Acquiring lock "cinder-quobyte-f6018153-b921-48ba-be9e-31968dd2e0f6" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Lock "cinder-quobyte-f6018153-b921-48ba-be9e-31968dd2e0f6" acquired by "delete_volume" :: waited 0.024s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:45 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec8a225-e6ac-4156-9bef-21c59588223c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6018153-b921-48ba-be9e-31968dd2e0f6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:45 devstack sudo[84940]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c598c47-1c38-4ca1-948e-a3a7c87de97c" returned: 0 in 1.020s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Lock "cinder-quobyte-7c598c47-1c38-4ca1-948e-a3a7c87de97c" released by "delete_volume" :: held 1.793s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:45 devstack sudo[84976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6018153-b921-48ba-be9e-31968dd2e0f6
Apr 24 19:55:45 devstack sudo[84976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:45 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Created reservations ['0fc48242-25e3-4d3f-bf7e-1824595c9464', '555522b0-8b99-4481-b2ce-983c7896ea8c', '7879af18-d045-4ed8-9a9c-72dd12de8dae', 'c5180c52-705e-4976-ad9c-47d8acaeadca'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:55:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:55:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:55:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:46 devstack sudo[84978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:55:46 devstack sudo[84978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:46 devstack sudo[84978]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.751s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:46 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:55:46 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Deleted volume successfully.
Apr 24 19:55:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8798d061-2741-4a2d-b1f4-bb07e1a0153c tempest-SnapshotsActionsTest-1276737476 None] Lock "cinder-7c598c47-1c38-4ca1-948e-a3a7c87de97c-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:47 devstack sudo[84976]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6018153-b921-48ba-be9e-31968dd2e0f6" returned: 0 in 1.340s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6018153-b921-48ba-be9e-31968dd2e0f6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:47 devstack sudo[84985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6018153-b921-48ba-be9e-31968dd2e0f6
Apr 24 19:55:47 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:48 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f6018153-b921-48ba-be9e-31968dd2e0f6" returned: 0 in 0.963s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Lock "cinder-quobyte-f6018153-b921-48ba-be9e-31968dd2e0f6" released by "delete_volume" :: held 2.382s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:48 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Created reservations ['dd09a33d-b0af-422b-9d0d-77fde6dd8f88', 'e5aabc64-ff97-4ca5-b316-349c2df62abc', '434669b1-ff96-4676-b50c-c9c4b11f6c06', '206fa7d7-1a2e-48cd-816f-333d816bdc01'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:55:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:55:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:55:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:48 devstack sudo[84990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:55:48 devstack sudo[84990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:49 devstack sudo[84990]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.022s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:49 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:55:49 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Deleted volume successfully.
Apr 24 19:55:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-77c7b369-e23d-4483-a6c9-586741457c1d tempest-VolumesActionsTest-584604081 None] Lock "cinder-f6018153-b921-48ba-be9e-31968dd2e0f6-delete_volume" released by "delete_volume" :: held 3.842s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:49 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Flow 'volume_create_manager' (817f8f6d-e899-4a58-8f1d-19857781f542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42ee151-41b0-4990-bfc5-d9316d636e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42ee151-41b0-4990-bfc5-d9316d636e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-658322062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684217f3-0fe6-4481-a551-cae1af79d316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ce3173ad44488b82dcae63850a42d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:50Z,use_quota=True,user_id='d9099e0470954a2790796acdf16b1511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb37f404-c385-4210-be13-9afd64a07cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb37f404-c385-4210-be13-9afd64a07cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306e1f22-4504-4ab6-83ac-4e20cf29a392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306e1f22-4504-4ab6-83ac-4e20cf29a392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '684217f3-0fe6-4481-a551-cae1af79d316', 'volume_name': 'volume-684217f3-0fe6-4481-a551-cae1af79d316', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aace17f-fe4d-4d29-aeb3-293053123839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aace17f-fe4d-4d29-aeb3-293053123839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18af1f6d-05ed-4552-b3b3-90268e431d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:50 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Volume 684217f3-0fe6-4481-a551-cae1af79d316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-684217f3-0fe6-4481-a551-cae1af79d316', 'volume_size': 1}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-658322062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684217f3-0fe6-4481-a551-cae1af79d316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ce3173ad44488b82dcae63850a42d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:50Z,use_quota=True,user_id='d9099e0470954a2790796acdf16b1511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Creating volume 684217f3-0fe6-4481-a551-cae1af79d316 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:55:50 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-684217f3-0fe6-4481-a551-cae1af79d316 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:50 devstack sudo[84994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-684217f3-0fe6-4481-a551-cae1af79d316 1073741824
Apr 24 19:55:50 devstack sudo[84994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Flow 'volume_create_manager' (ff4f1cde-03e5-457f-a0dd-6100774e1385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b83588c-93f6-43a7-b7df-99388e0c62f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b83588c-93f6-43a7-b7df-99388e0c62f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-905077102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bee7428-f55b-413b-b1a3-cac183af75df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550c77d6b1dc4c3196efca6fd567cb1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:51Z,use_quota=True,user_id='d4186f21ab6448babd701229879faa31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cc4c98-1b66-493f-981d-6a319e1f64ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cc4c98-1b66-493f-981d-6a319e1f64ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d3fad3-f36a-4a75-9511-dd53d6dbfaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d3fad3-f36a-4a75-9511-dd53d6dbfaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bee7428-f55b-413b-b1a3-cac183af75df', 'volume_name': 'volume-9bee7428-f55b-413b-b1a3-cac183af75df', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be84e488-a4c0-4502-a5de-d9b447bf396e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be84e488-a4c0-4502-a5de-d9b447bf396e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (290b664e-a917-4e92-94d7-857284a1021d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:51 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Volume 9bee7428-f55b-413b-b1a3-cac183af75df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bee7428-f55b-413b-b1a3-cac183af75df', 'volume_size': 1}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:51 devstack sudo[84994]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-684217f3-0fe6-4481-a551-cae1af79d316 1073741824" returned: 0 in 1.110s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-684217f3-0fe6-4481-a551-cae1af79d316 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:51 devstack sudo[85009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-684217f3-0fe6-4481-a551-cae1af79d316
Apr 24 19:55:51 devstack sudo[85009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:51 devstack sudo[85009]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-684217f3-0fe6-4481-a551-cae1af79d316" returned: 0 in 0.518s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.725s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-905077102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bee7428-f55b-413b-b1a3-cac183af75df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550c77d6b1dc4c3196efca6fd567cb1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:51Z,use_quota=True,user_id='d4186f21ab6448babd701229879faa31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Creating volume 9bee7428-f55b-413b-b1a3-cac183af75df {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:55:51 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:51 devstack sudo[85031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df 1073741824
Apr 24 19:55:51 devstack sudo[85031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18af1f6d-05ed-4552-b3b3-90268e431d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-684217f3-0fe6-4481-a551-cae1af79d316', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7771f692-d607-41d9-8cb2-a8d430d0c72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:51 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Volume volume-684217f3-0fe6-4481-a551-cae1af79d316 (684217f3-0fe6-4481-a551-cae1af79d316): created successfully
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7771f692-d607-41d9-8cb2-a8d430d0c72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Flow 'volume_create_manager' (817f8f6d-e899-4a58-8f1d-19857781f542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:55:51 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-5de79a26-3cdb-4003-97cd-8180ea338559 tempest-VolumesActionsTest-1762206869 None] Created volume successfully.
Apr 24 19:55:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Acquiring lock "cinder-684217f3-0fe6-4481-a551-cae1af79d316-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Lock "cinder-684217f3-0fe6-4481-a551-cae1af79d316-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Acquiring lock "cinder-quobyte-684217f3-0fe6-4481-a551-cae1af79d316" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:55:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Lock "cinder-quobyte-684217f3-0fe6-4481-a551-cae1af79d316" acquired by "delete_volume" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:55:52 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58a93d8-dd21-469e-9378-db90c7ee0285]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-684217f3-0fe6-4481-a551-cae1af79d316 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:52 devstack sudo[85031]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df 1073741824" returned: 0 in 0.924s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:52 devstack sudo[85043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-684217f3-0fe6-4481-a551-cae1af79d316
Apr 24 19:55:52 devstack sudo[85043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:52 devstack sudo[85047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df
Apr 24 19:55:52 devstack sudo[85047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:53 devstack sudo[85047]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df" returned: 0 in 0.564s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:53 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:55:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (290b664e-a917-4e92-94d7-857284a1021d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bee7428-f55b-413b-b1a3-cac183af75df', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30eff2a6-5802-49b7-bbc4-d5f6abf810dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:53 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Volume volume-9bee7428-f55b-413b-b1a3-cac183af75df (9bee7428-f55b-413b-b1a3-cac183af75df): created successfully
Apr 24 19:55:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30eff2a6-5802-49b7-bbc4-d5f6abf810dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Flow 'volume_create_manager' (ff4f1cde-03e5-457f-a0dd-6100774e1385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:55:53 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-b5825f06-31a8-448b-afee-b63ac4da902d req-f8107eb5-7056-4311-be3d-941c90780698 tempest-VolumesSnapshotsTestJSON-187199689 None] Created volume successfully.
Apr 24 19:55:53 devstack sudo[85043]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-684217f3-0fe6-4481-a551-cae1af79d316" returned: 0 in 0.779s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-684217f3-0fe6-4481-a551-cae1af79d316 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:53 devstack sudo[85070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-684217f3-0fe6-4481-a551-cae1af79d316
Apr 24 19:55:53 devstack sudo[85070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:54 devstack sudo[85070]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-684217f3-0fe6-4481-a551-cae1af79d316" returned: 0 in 0.708s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Lock "cinder-quobyte-684217f3-0fe6-4481-a551-cae1af79d316" released by "delete_volume" :: held 1.547s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:54 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Created reservations ['5d6b95ff-2388-4a00-9b4e-122f96f5536f', 'a8d988d7-c977-4289-af65-241dda84e41c', 'f11d3aba-6899-442a-b8cd-80ebbf5739fa', '01972a54-7288-487d-a1c1-d16721c1d418'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:55:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:55:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:55:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:54 devstack sudo[85093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:55:54 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] Creating offline snapshot 593e0463-d824-45ca-9794-2bc0c63fab85 of volume 9bee7428-f55b-413b-b1a3-cac183af75df {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 19:55:55 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.002s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e889f2-4066-4324-9260-32ebdffe5426]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:55 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Deleted volume successfully.
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9a4fa812-14f4-466c-a597-845f89f14248 tempest-VolumesActionsTest-584604081 None] Lock "cinder-684217f3-0fe6-4481-a551-cae1af79d316-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:55:55 devstack sudo[85096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df
Apr 24 19:55:55 devstack sudo[85096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Flow 'volume_create_manager' (709d7e76-cc4a-4400-ac73-4497a25237f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03439c6e-a1b1-486d-8346-7ca3d39dd497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03439c6e-a1b1-486d-8346-7ca3d39dd497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1725267068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538002a4-0728-42eb-a4a3-3c4125051949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ce3173ad44488b82dcae63850a42d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:55Z,use_quota=True,user_id='d9099e0470954a2790796acdf16b1511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc5a704-2642-403f-8628-26dba1d5a289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc5a704-2642-403f-8628-26dba1d5a289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789c6db3-9e5e-4ae6-a6a1-c1dc0a1650ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789c6db3-9e5e-4ae6-a6a1-c1dc0a1650ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '538002a4-0728-42eb-a4a3-3c4125051949', 'volume_name': 'volume-538002a4-0728-42eb-a4a3-3c4125051949', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71cebf2a-dd31-4908-aafb-daf61603c71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71cebf2a-dd31-4908-aafb-daf61603c71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fc12fd-dcda-48f1-9366-67c38e8c6243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:55:55 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Volume 538002a4-0728-42eb-a4a3-3c4125051949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-538002a4-0728-42eb-a4a3-3c4125051949', 'volume_size': 1}
Apr 24 19:55:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:56 devstack sudo[85096]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df" returned: 0 in 0.755s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:56 devstack sudo[85117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85 1G
Apr 24 19:55:56 devstack sudo[85117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:56 devstack sudo[85117]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85 1G" returned: 0 in 0.853s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bee7428-f55b-413b-b1a3-cac183af75df -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:56 devstack sudo[85126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bee7428-f55b-413b-b1a3-cac183af75df -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85
Apr 24 19:55:56 devstack sudo[85126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:57 devstack sudo[85126]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bee7428-f55b-413b-b1a3-cac183af75df -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85" returned: 0 in 0.579s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:57 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85 is being set with open permissions: ugo+rw
Apr 24 19:55:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:57 devstack sudo[85133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85
Apr 24 19:55:57 devstack sudo[85133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:58 devstack sudo[85133]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85" returned: 0 in 0.563s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:58 devstack sudo[85136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.info
Apr 24 19:55:58 devstack sudo[85136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:58 devstack sudo[85136]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.info" returned: 0 in 0.563s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:58 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.info is being set with open permissions: ugo+rw
Apr 24 19:55:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:58 devstack sudo[85139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.info
Apr 24 19:55:58 devstack sudo[85139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:59 devstack sudo[85139]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.info" returned: 0 in 0.530s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:55:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.035s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.664s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1725267068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538002a4-0728-42eb-a4a3-3c4125051949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ce3173ad44488b82dcae63850a42d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:55Z,use_quota=True,user_id='d9099e0470954a2790796acdf16b1511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:55:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Creating volume 538002a4-0728-42eb-a4a3-3c4125051949 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:55:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:55:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:55:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:55:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:55:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:55:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:55:59 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:55:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-538002a4-0728-42eb-a4a3-3c4125051949 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:55:59 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-ef8ad3e5-0fce-4116-88fb-0f38ef6fed28 req-2db70ab8-72c9-41ff-b0ea-c89b0320b6e8 tempest-VolumesSnapshotsTestJSON-187199689 None] Create snapshot completed successfully
Apr 24 19:55:59 devstack sudo[85143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-538002a4-0728-42eb-a4a3-3c4125051949 1073741824
Apr 24 19:55:59 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:55:59 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root
Apr 24 19:55:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-538002a4-0728-42eb-a4a3-3c4125051949 1073741824" returned: 0 in 0.712s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-538002a4-0728-42eb-a4a3-3c4125051949 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:00 devstack sudo[85148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-538002a4-0728-42eb-a4a3-3c4125051949
Apr 24 19:56:00 devstack sudo[85148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Acquiring lock "cinder-593e0463-d824-45ca-9794-2bc0c63fab85-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "cinder-593e0463-d824-45ca-9794-2bc0c63fab85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Acquiring lock "cinder-quobyte-9bee7428-f55b-413b-b1a3-cac183af75df" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "cinder-quobyte-9bee7428-f55b-413b-b1a3-cac183af75df" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Acquiring lock "cinder-quobyte-593e0463-d824-45ca-9794-2bc0c63fab85" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "cinder-quobyte-593e0463-d824-45ca-9794-2bc0c63fab85" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Deleting offline snapshot 593e0463-d824-45ca-9794-2bc0c63fab85 of volume 9bee7428-f55b-413b-b1a3-cac183af75df {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] snapshot_file for this snap is: volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbfa791-972a-4f79-b369-ce57e8da4534]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:00 devstack sudo[85150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85
Apr 24 19:56:00 devstack sudo[85150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:00 devstack sudo[85148]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-538002a4-0728-42eb-a4a3-3c4125051949" returned: 0 in 0.675s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fc12fd-dcda-48f1-9366-67c38e8c6243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-538002a4-0728-42eb-a4a3-3c4125051949', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade38921-ddd5-4769-9fc6-786011915208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:00 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Volume volume-538002a4-0728-42eb-a4a3-3c4125051949 (538002a4-0728-42eb-a4a3-3c4125051949): created successfully
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade38921-ddd5-4769-9fc6-786011915208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:00 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Flow 'volume_create_manager' (709d7e76-cc4a-4400-ac73-4497a25237f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:56:00 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-74884b90-5665-4562-b1db-8d04703e24d7 tempest-VolumesActionsTest-1762206869 None] Created volume successfully.
Apr 24 19:56:01 devstack sudo[85150]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85" returned: 0 in 0.650s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:01 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bee7428-f55b-413b-b1a3-cac183af75df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:56:01 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b65394-1642-4f4f-8ec7-0f0ac26d5443]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:01 devstack sudo[85156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df
Apr 24 19:56:01 devstack sudo[85156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:01 devstack sudo[85156]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df" returned: 0 in 0.753s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:01 devstack sudo[85161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85
Apr 24 19:56:01 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Acquiring lock "cinder-538002a4-0728-42eb-a4a3-3c4125051949-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Lock "cinder-538002a4-0728-42eb-a4a3-3c4125051949-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Acquiring lock "cinder-quobyte-538002a4-0728-42eb-a4a3-3c4125051949" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Lock "cinder-quobyte-538002a4-0728-42eb-a4a3-3c4125051949" acquired by "delete_volume" :: waited 0.029s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:02 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5739a9c-67f8-4431-acf7-214e461602b9]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-538002a4-0728-42eb-a4a3-3c4125051949 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:02 devstack sudo[85163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-538002a4-0728-42eb-a4a3-3c4125051949
Apr 24 19:56:02 devstack sudo[85163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:02 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85" returned: 0 in 0.847s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:02 devstack sudo[85168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85
Apr 24 19:56:02 devstack sudo[85168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:02 devstack sudo[85163]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-538002a4-0728-42eb-a4a3-3c4125051949" returned: 0 in 0.660s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-538002a4-0728-42eb-a4a3-3c4125051949 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:02 devstack sudo[85173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-538002a4-0728-42eb-a4a3-3c4125051949
Apr 24 19:56:02 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:03 devstack sudo[85168]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df.593e0463-d824-45ca-9794-2bc0c63fab85" returned: 0 in 0.762s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "cinder-quobyte-593e0463-d824-45ca-9794-2bc0c63fab85" released by "_delete_snapshot" :: held 3.182s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "cinder-quobyte-9bee7428-f55b-413b-b1a3-cac183af75df" released by "delete_snapshot" :: held 3.213s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:03 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-538002a4-0728-42eb-a4a3-3c4125051949" returned: 0 in 0.666s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Lock "cinder-quobyte-538002a4-0728-42eb-a4a3-3c4125051949" released by "delete_volume" :: held 1.402s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:03 devstack cinder-volume[81241]: DEBUG cinder.quota [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Created reservations ['a10c8f26-4c1d-479d-a76d-645bcdbd9d2b', '1f6f9873-4fd4-4fb9-afa4-3598d2a0d68a', '1e82659b-a71c-42f4-b681-263f6c6608ab', 'eaecec1f-168b-4d1c-9e84-227cb42c89cb'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:56:03 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Created reservations ['06fd99f7-6c3f-4da0-87e2-64916d902cd1', '9040fecf-8e10-4419-8dd1-58a6b509e2dc', '53801f5f-aba0-48c0-876d-aa2c90ce4458', '558628a5-d176-4ce8-89ea-a6249f073491'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:56:03 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Delete snapshot completed successfully.
Apr 24 19:56:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-02f7f19e-3783-458c-95f6-86f27c75c9a1 req-252d33d7-778f-4c13-bd1d-bf17ff89f083 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "cinder-593e0463-d824-45ca-9794-2bc0c63fab85-delete_snapshot" released by "delete_snapshot" :: held 3.498s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:03 devstack sudo[85194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:56:03 devstack sudo[85194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:04 devstack sudo[85194]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.572s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:56:04 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Deleted volume successfully.
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-dec4a504-b642-4a2d-b3bf-188c669020dd tempest-VolumesActionsTest-584604081 None] Lock "cinder-538002a4-0728-42eb-a4a3-3c4125051949-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Acquiring lock "cinder-9bee7428-f55b-413b-b1a3-cac183af75df-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "cinder-9bee7428-f55b-413b-b1a3-cac183af75df-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Acquiring lock "cinder-quobyte-9bee7428-f55b-413b-b1a3-cac183af75df" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "cinder-quobyte-9bee7428-f55b-413b-b1a3-cac183af75df" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4728c6a0-e36f-48f7-a0d4-d7d4ce8fe214]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Flow 'volume_create_manager' (18bcb805-a35e-47a6-bdfb-c918ba69f5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91e2b90-e0f3-4d5a-a366-2c095aaf0019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91e2b90-e0f3-4d5a-a366-2c095aaf0019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-324784364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55cbfe4-9242-46e5-b186-01e5809ea169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ce3173ad44488b82dcae63850a42d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:05Z,use_quota=True,user_id='d9099e0470954a2790796acdf16b1511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e605d023-ec0b-44af-bea2-547aaf5d6930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:04 devstack sudo[85199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df
Apr 24 19:56:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e605d023-ec0b-44af-bea2-547aaf5d6930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:04 devstack sudo[85199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63f2cd1-5cd3-41de-ba9b-40d80986aa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63f2cd1-5cd3-41de-ba9b-40d80986aa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a55cbfe4-9242-46e5-b186-01e5809ea169', 'volume_name': 'volume-a55cbfe4-9242-46e5-b186-01e5809ea169', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a7e8c7-3931-49eb-9fb5-6054c9ac1028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a7e8c7-3931-49eb-9fb5-6054c9ac1028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a772ee-75b7-4963-bca0-a54519dac03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:05 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Volume a55cbfe4-9242-46e5-b186-01e5809ea169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a55cbfe4-9242-46e5-b186-01e5809ea169', 'volume_size': 1}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-324784364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55cbfe4-9242-46e5-b186-01e5809ea169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ce3173ad44488b82dcae63850a42d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:05Z,use_quota=True,user_id='d9099e0470954a2790796acdf16b1511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Creating volume a55cbfe4-9242-46e5-b186-01e5809ea169 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:56:05 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a55cbfe4-9242-46e5-b186-01e5809ea169 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:05 devstack sudo[85201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a55cbfe4-9242-46e5-b186-01e5809ea169 1073741824
Apr 24 19:56:05 devstack sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:05 devstack sudo[85199]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df" returned: 0 in 0.663s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:05 devstack sudo[85209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df
Apr 24 19:56:05 devstack sudo[85209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:05 devstack sudo[85201]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a55cbfe4-9242-46e5-b186-01e5809ea169 1073741824" returned: 0 in 0.776s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a55cbfe4-9242-46e5-b186-01e5809ea169 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:05 devstack sudo[85211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a55cbfe4-9242-46e5-b186-01e5809ea169
Apr 24 19:56:05 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:06 devstack sudo[85209]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9bee7428-f55b-413b-b1a3-cac183af75df" returned: 0 in 0.750s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "cinder-quobyte-9bee7428-f55b-413b-b1a3-cac183af75df" released by "delete_volume" :: held 1.533s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG cinder.quota [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Created reservations ['4e6362a4-54e5-4688-9560-69aa609e74b0', 'a0d7aef5-6b18-44af-a693-c5786be6ed4a', '9965ae99-a65a-486d-9954-26747a9f98b7', 'd373011b-44e5-4683-aa9e-dac7b31cd3c6'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:06 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a55cbfe4-9242-46e5-b186-01e5809ea169" returned: 0 in 0.654s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:06 devstack sudo[85215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:56:06 devstack sudo[85215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a772ee-75b7-4963-bca0-a54519dac03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a55cbfe4-9242-46e5-b186-01e5809ea169', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0079b8-59f6-4cb0-8ab3-7871dd2ff185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:06 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Volume volume-a55cbfe4-9242-46e5-b186-01e5809ea169 (a55cbfe4-9242-46e5-b186-01e5809ea169): created successfully
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0079b8-59f6-4cb0-8ab3-7871dd2ff185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Flow 'volume_create_manager' (18bcb805-a35e-47a6-bdfb-c918ba69f5c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:56:06 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-847ff34c-ebcc-46d2-af6f-82248f66afaf tempest-VolumesActionsTest-1762206869 None] Created volume successfully.
Apr 24 19:56:07 devstack sudo[85215]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.495s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.manager [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:56:07 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Deleted volume successfully.
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-a161cdfe-00c9-4cd3-a404-17d4f7f712d8 req-f7887374-6707-4b53-99be-2a8d43b12152 tempest-VolumesSnapshotsTestJSON-187199689 None] Lock "cinder-9bee7428-f55b-413b-b1a3-cac183af75df-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Flow 'volume_create_manager' (4881f0f8-0d8f-4c44-ad7f-bddfe5fbdaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a356755-cc81-43a8-8e4b-b6852d9c9f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a356755-cc81-43a8-8e4b-b6852d9c9f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-601251245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45934818-c678-4aba-b584-90005c16e974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53091bb2e5e4b9892b959017b584fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:08Z,use_quota=True,user_id='a1b7730ff490452dbf61b3bf1aecc7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa8b59b-d06d-499e-9517-acc9a9f76e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa8b59b-d06d-499e-9517-acc9a9f76e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa922ce-674e-492c-af7d-99e36af8439b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa922ce-674e-492c-af7d-99e36af8439b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45934818-c678-4aba-b584-90005c16e974', 'volume_name': 'volume-45934818-c678-4aba-b584-90005c16e974', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12ba3ef-c547-4d4d-ac55-64d357d6acdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12ba3ef-c547-4d4d-ac55-64d357d6acdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca374b13-8155-4d0f-8884-0bb759cd9d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:07 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Volume 45934818-c678-4aba-b584-90005c16e974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45934818-c678-4aba-b584-90005c16e974', 'volume_size': 1}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-601251245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45934818-c678-4aba-b584-90005c16e974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53091bb2e5e4b9892b959017b584fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:08Z,use_quota=True,user_id='a1b7730ff490452dbf61b3bf1aecc7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Creating volume 45934818-c678-4aba-b584-90005c16e974 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:56:07 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-45934818-c678-4aba-b584-90005c16e974 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:07 devstack sudo[85222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-45934818-c678-4aba-b584-90005c16e974 1073741824
Apr 24 19:56:07 devstack sudo[85222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "cinder-a55cbfe4-9242-46e5-b186-01e5809ea169-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Lock "cinder-a55cbfe4-9242-46e5-b186-01e5809ea169-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "cinder-quobyte-a55cbfe4-9242-46e5-b186-01e5809ea169" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:08 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Lock "cinder-quobyte-a55cbfe4-9242-46e5-b186-01e5809ea169" acquired by "delete_volume" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:08 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[962ac9d5-db6a-409e-80e4-aacc58765edc]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a55cbfe4-9242-46e5-b186-01e5809ea169 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:08 devstack sudo[85224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a55cbfe4-9242-46e5-b186-01e5809ea169
Apr 24 19:56:08 devstack sudo[85224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:08 devstack sudo[85222]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-45934818-c678-4aba-b584-90005c16e974 1073741824" returned: 0 in 0.878s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:08 devstack sudo[85224]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a55cbfe4-9242-46e5-b186-01e5809ea169" returned: 0 in 0.656s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a55cbfe4-9242-46e5-b186-01e5809ea169 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-45934818-c678-4aba-b584-90005c16e974 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:08 devstack sudo[85232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a55cbfe4-9242-46e5-b186-01e5809ea169
Apr 24 19:56:08 devstack sudo[85232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:08 devstack sudo[85234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-45934818-c678-4aba-b584-90005c16e974
Apr 24 19:56:08 devstack sudo[85234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:09 devstack sudo[85232]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a55cbfe4-9242-46e5-b186-01e5809ea169" returned: 0 in 0.640s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Lock "cinder-quobyte-a55cbfe4-9242-46e5-b186-01e5809ea169" released by "delete_volume" :: held 1.345s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:09 devstack sudo[85234]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-45934818-c678-4aba-b584-90005c16e974" returned: 0 in 0.681s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca374b13-8155-4d0f-8884-0bb759cd9d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45934818-c678-4aba-b584-90005c16e974', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f89589d-b9e5-4c0f-9da0-2824b27624df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Created reservations ['17ff1c48-5ee2-497b-9d88-e60b4f9c8681', '6d952cf1-66d5-47dd-b250-8f8804e64e1e', '56895241-3ea0-4191-a445-41644c85f642', 'a268794d-f511-41c1-b799-7ff463df4043'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:56:09 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Volume volume-45934818-c678-4aba-b584-90005c16e974 (45934818-c678-4aba-b584-90005c16e974): created successfully
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f89589d-b9e5-4c0f-9da0-2824b27624df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Flow 'volume_create_manager' (4881f0f8-0d8f-4c44-ad7f-bddfe5fbdaec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:09 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a810218e-2602-49b5-8d69-74e4379550bc tempest-VolumesServicesTestJSON-1405554519 None] Created volume successfully.
Apr 24 19:56:09 devstack sudo[85245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:56:09 devstack sudo[85245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:10 devstack sudo[85245]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.523s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:10 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:56:10 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Deleted volume successfully.
Apr 24 19:56:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d5bc9e1e-cb1f-4e2c-b071-e045af2bfe82 tempest-VolumesActionsTest-1762206869 None] Lock "cinder-a55cbfe4-9242-46e5-b186-01e5809ea169-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Acquiring lock "cinder-45934818-c678-4aba-b584-90005c16e974-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Lock "cinder-45934818-c678-4aba-b584-90005c16e974-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Acquiring lock "cinder-quobyte-45934818-c678-4aba-b584-90005c16e974" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Lock "cinder-quobyte-45934818-c678-4aba-b584-90005c16e974" acquired by "delete_volume" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:10 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace78354-11f1-454a-9275-74c63895ada9]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-45934818-c678-4aba-b584-90005c16e974 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:10 devstack sudo[85260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-45934818-c678-4aba-b584-90005c16e974
Apr 24 19:56:10 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:11 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-45934818-c678-4aba-b584-90005c16e974" returned: 0 in 0.958s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-45934818-c678-4aba-b584-90005c16e974 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:11 devstack sudo[85293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-45934818-c678-4aba-b584-90005c16e974
Apr 24 19:56:11 devstack sudo[85293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:12 devstack sudo[85293]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-45934818-c678-4aba-b584-90005c16e974" returned: 0 in 0.964s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:12 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Lock "cinder-quobyte-45934818-c678-4aba-b584-90005c16e974" released by "delete_volume" :: held 2.025s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:12 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Created reservations ['2f24f62e-dfa0-400e-b792-804d69db9707', 'e06907dc-ad4c-4045-8f9c-d5e6980fe85c', '3027be32-279b-4f77-bdbb-dcd451817aaa', 'fc091d20-07ad-4e64-afbc-d3e5eba610e6'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:56:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:12 devstack sudo[85298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:56:12 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:13 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.017s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:13 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:56:13 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Deleted volume successfully.
Apr 24 19:56:13 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-78117007-123b-4ecb-8085-1fb1fb5be1dd tempest-VolumesServicesTestJSON-1405554519 None] Lock "cinder-45934818-c678-4aba-b584-90005c16e974-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:22 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-2fd5061c-ac9b-4ee4-b31a-c0e0db36c22d tempest-GroupsV314Test-1573003222 None] Group tempest-GroupsV314Test-Group-2039198922: creating
Apr 24 19:56:22 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-2fd5061c-ac9b-4ee4-b31a-c0e0db36c22d tempest-GroupsV314Test-1573003222 None] Group tempest-GroupsV314Test-Group-2039198922: created successfully
Apr 24 19:56:22 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-2fd5061c-ac9b-4ee4-b31a-c0e0db36c22d tempest-GroupsV314Test-1573003222 None] Create group completed successfully.
Apr 24 19:56:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 19:56:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:24 devstack sudo[85392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:56:24 devstack sudo[85392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Flow 'volume_create_manager' (9284eb7a-8f35-428c-9019-43bb4f669096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c12deda-7c4d-4a07-93c3-c696109821f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c12deda-7c4d-4a07-93c3-c696109821f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1164650699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1e110b7f-de2e-48d2-8fd4-5fab7a51aa73,host='devstack@QuobyteHD#QuobyteHD',id=7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349e1ff03c804ce381e7577c38f15749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:24Z,use_quota=True,user_id='0a2b44ef7feb4051bcc89bfee5fdb830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc23827e-a819-433c-b183-400f9ad31b7a),volume_type_id=bc23827e-a819-433c-b183-400f9ad31b7a)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebddb2d-4118-41fe-ac22-1af1834d2b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebddb2d-4118-41fe-ac22-1af1834d2b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ee3646-b83a-4ea1-8617-a26e08263f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ee3646-b83a-4ea1-8617-a26e08263f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4', 'volume_name': 'volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc177c31-9ecf-49fb-a936-e39006a09e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc177c31-9ecf-49fb-a936-e39006a09e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09a43cf-acd3-43ae-8246-6540c4db662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:24 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Volume 7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4', 'volume_size': 1}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1e110b7f-de2e-48d2-8fd4-5fab7a51aa73,created_at=2026-04-24T17:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1164650699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1e110b7f-de2e-48d2-8fd4-5fab7a51aa73,host='devstack@QuobyteHD#QuobyteHD',id=7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349e1ff03c804ce381e7577c38f15749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:24Z,use_quota=True,user_id='0a2b44ef7feb4051bcc89bfee5fdb830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc23827e-a819-433c-b183-400f9ad31b7a),volume_type_id=bc23827e-a819-433c-b183-400f9ad31b7a)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Creating volume 7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:56:24 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:56:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:24 devstack sudo[85395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 1073741824
Apr 24 19:56:24 devstack sudo[85395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:25 devstack sudo[85392]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.025s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:25 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:56:25 devstack sudo[85395]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 1073741824" returned: 0 in 0.993s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:25 devstack sudo[85401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4
Apr 24 19:56:25 devstack sudo[85401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:25 devstack sudo[85401]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4" returned: 0 in 0.544s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:56:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09a43cf-acd3-43ae-8246-6540c4db662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e26efc-0b58-43fc-b01c-0339d3c8f68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:25 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Volume volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 (7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4): created successfully
Apr 24 19:56:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e26efc-0b58-43fc-b01c-0339d3c8f68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Flow 'volume_create_manager' (9284eb7a-8f35-428c-9019-43bb4f669096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:56:25 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-ee60a326-dded-4acd-9877-5348c9e396e9 tempest-GroupsV314Test-1573003222 None] Created volume successfully.
Apr 24 19:56:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:27 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Cloning volume 7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 to volume c075a927-c3f9-45dc-be05-23d594b7e353
Apr 24 19:56:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Creating offline snapshot fe98575a-0057-4cf0-82cf-22946390413c of volume 7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 19:56:27 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[436d55e6-62db-4baa-9a72-ecf6f8fb5c23]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:27 devstack sudo[85409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4
Apr 24 19:56:27 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:28 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4" returned: 0 in 0.693s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:28 devstack sudo[85415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c 1G
Apr 24 19:56:28 devstack sudo[85415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:28 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:56:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Flow 'volume_create_manager' (cf6da0fe-95de-49b7-8daf-c89392a99a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:56:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526fd240-1734-44e5-86a7-b266e2cba665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526fd240-1734-44e5-86a7-b266e2cba665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1196619995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3690e8-419d-4275-bc50-28e19b7556db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7404448297a4592a2ebed4a739a9570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:29Z,use_quota=True,user_id='44023fb33b2948b590f22558da9d6c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7488102-5382-458c-9edf-947396c8e072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7488102-5382-458c-9edf-947396c8e072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26a354f-92a7-44fb-ad73-6d51757afcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26a354f-92a7-44fb-ad73-6d51757afcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3690e8-419d-4275-bc50-28e19b7556db', 'volume_name': 'volume-0d3690e8-419d-4275-bc50-28e19b7556db', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989bbd88-c2db-4ffa-969e-856a68a87808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989bbd88-c2db-4ffa-969e-856a68a87808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4611cc3-9ca2-48bf-9200-f205a16d11d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:28 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Volume 0d3690e8-419d-4275-bc50-28e19b7556db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3690e8-419d-4275-bc50-28e19b7556db', 'volume_size': 1}
Apr 24 19:56:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:29 devstack sudo[85415]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c 1G" returned: 0 in 0.713s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:29 devstack sudo[85421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c
Apr 24 19:56:29 devstack sudo[85421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:29 devstack sudo[85421]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c" returned: 0 in 0.639s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:29 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 19:56:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:29 devstack sudo[85426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c
Apr 24 19:56:29 devstack sudo[85426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:30 devstack sudo[85426]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c" returned: 0 in 0.524s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:30 devstack sudo[85429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.info
Apr 24 19:56:30 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:30 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.info" returned: 0 in 0.554s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:30 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 19:56:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:30 devstack sudo[85432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.info
Apr 24 19:56:30 devstack sudo[85432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:31 devstack sudo[85432]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.info" returned: 0 in 0.499s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Acquiring lock "cinder-quobyte-c075a927-c3f9-45dc-be05-23d594b7e353" by "_copy_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Lock "cinder-quobyte-c075a927-c3f9-45dc-be05-23d594b7e353" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] snapshot: fe98575a-0057-4cf0-82cf-22946390413c, volume: c075a927-c3f9-45dc-be05-23d594b7e353,  {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d06f96-b8a2-49bc-89b2-eb7ad7cb7e52]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:56:31 devstack sudo[85435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c
Apr 24 19:56:31 devstack sudo[85435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Flow 'volume_create_manager' (530f2e3d-77ca-432d-89bb-d38eef709a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560d8528-7f6a-4fe6-8d15-e26bf6bb3b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560d8528-7f6a-4fe6-8d15-e26bf6bb3b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-921661137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bee385a-4674-47e4-8661-79a72fdac105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc185fc1ebf04238a7b73751a10b3a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:31Z,use_quota=True,user_id='d5785a451d664b349b50a776bdd0e3a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8326fbf5-2874-4fd8-a812-5b7b1e98b5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8326fbf5-2874-4fd8-a812-5b7b1e98b5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45b6e4c-6f21-496e-95b6-def9630a324b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.image.glance [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Creating Keystone auth plugin from conf {{(pid=81241) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45b6e4c-6f21-496e-95b6-def9630a324b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0bee385a-4674-47e4-8661-79a72fdac105', 'volume_name': 'volume-0bee385a-4674-47e4-8661-79a72fdac105', 'volume_size': 1, 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b862a13976c94661b0ca990e233a527c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'created_at': datetime.datetime(2026, 4, 24, 17, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 48, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f02e7dd5ea0>}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599b5c72-ff22-40ed-bd61-bcb8ba108953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599b5c72-ff22-40ed-bd61-bcb8ba108953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0353842-b5fb-4f65-a043-f45a40d04fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:31 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Volume 0bee385a-4674-47e4-8661-79a72fdac105: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0bee385a-4674-47e4-8661-79a72fdac105', 'volume_size': 1, 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b862a13976c94661b0ca990e233a527c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'created_at': datetime.datetime(2026, 4, 24, 17, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 48, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f02e7dd5ea0>}
Apr 24 19:56:31 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Trying to clone 0bee385a-4674-47e4-8661-79a72fdac105 from image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]). {{(pid=81241) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 24 19:56:32 devstack sudo[85435]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c" returned: 0 in 0.689s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:56:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 19:56:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Creating direct copy from snapshot {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 19:56:32 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3617a2e-07b2-4e85-8c9f-3b36085c62ed]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:32 devstack sudo[85460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4
Apr 24 19:56:32 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:32 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_f0rwdeyvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81241) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 24 19:56:32 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Image download 20.69 MB at 20.69 MB/s
Apr 24 19:56:32 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ad65b-048d-4a46-9f0e-e82d257994c9]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_f0rwdeyvdevstack@QuobyteHD {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:32 devstack sudo[85463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_f0rwdeyvdevstack@QuobyteHD
Apr 24 19:56:32 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:32 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4" returned: 0 in 0.758s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:32 devstack cinder-volume[81241]: DEBUG cinder.utils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Path /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353 not found in is_blk_device check {{(pid=81241) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 19:56:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:32 devstack sudo[85468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353
Apr 24 19:56:32 devstack sudo[85468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:33 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_f0rwdeyvdevstack@QuobyteHD" returned: 0 in 0.593s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:33 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Temporary image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd is fetched for user d5785a451d664b349b50a776bdd0e3a8. {{(pid=81241) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 24 19:56:33 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[262852db-d827-46c8-8fd2-136987121375]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_f0rwdeyvdevstack@QuobyteHD {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:33 devstack sudo[85473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_f0rwdeyvdevstack@QuobyteHD
Apr 24 19:56:33 devstack sudo[85473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:34 devstack sudo[85473]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_f0rwdeyvdevstack@QuobyteHD" returned: 0 in 0.892s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:35 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:56:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Flow 'volume_create_manager' (c0734a0b-41cf-4a1a-8dcb-89a5e89a0190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:56:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6c6db6-991e-4e91-93f6-3d85294cd0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6c6db6-991e-4e91-93f6-3d85294cd0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:56:34Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3dc8b8-020b-433f-bee0-6ad362d068f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7076d4b273b94478a8b0caa2b6e338f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:35Z,use_quota=True,user_id='509d147b94704c9cb3c8e99ea2b69578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68eaae57-3707-4fb2-871a-7ca3a6b9618d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68eaae57-3707-4fb2-871a-7ca3a6b9618d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8783b0-c437-44af-8343-2ad17742412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:35 devstack cinder-volume[81241]: DEBUG cinder.image.glance [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Creating Keystone auth plugin from conf {{(pid=81241) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 24 19:56:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8783b0-c437-44af-8343-2ad17742412a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eb3dc8b8-020b-433f-bee0-6ad362d068f5', 'volume_name': 'volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5', 'volume_size': 1, 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b862a13976c94661b0ca990e233a527c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'created_at': datetime.datetime(2026, 4, 24, 17, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 48, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f02e7877b20>}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576b5a19-d287-43e5-bc00-c5bf1d82e062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576b5a19-d287-43e5-bc00-c5bf1d82e062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64663d02-d394-412b-983f-fb009b28c0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:35 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Volume eb3dc8b8-020b-433f-bee0-6ad362d068f5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5', 'volume_size': 1, 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b862a13976c94661b0ca990e233a527c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'created_at': datetime.datetime(2026, 4, 24, 17, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 48, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f02e7877b20>}
Apr 24 19:56:35 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Trying to clone eb3dc8b8-020b-433f-bee0-6ad362d068f5 from image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]). {{(pid=81241) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 24 19:56:36 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_h8k102w5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81241) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 24 19:56:36 devstack cinder-volume[81241]: INFO cinder.image.image_utils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Image download 20.69 MB at 20.69 MB/s
Apr 24 19:56:36 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dea8761-a4e0-4408-bdde-da0b78a3e83e]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_h8k102w5devstack@QuobyteHD {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:36 devstack sudo[85507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_h8k102w5devstack@QuobyteHD
Apr 24 19:56:36 devstack sudo[85507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:38 devstack sudo[85507]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_h8k102w5devstack@QuobyteHD" returned: 0 in 1.669s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:38 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Temporary image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd is fetched for user 509d147b94704c9cb3c8e99ea2b69578. {{(pid=81241) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 24 19:56:38 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:UPDATE=90,cinder:SELECT=86,cinder:INSERT=35,cinder:DELETE=9 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:56:38 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=88,cinder:INSERT=21,cinder:UPDATE=128,cinder:DELETE=8 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:56:38 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fd4905-d89f-4c3d-a540-67d40951ac63]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_h8k102w5devstack@QuobyteHD {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:38 devstack sudo[85546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_h8k102w5devstack@QuobyteHD
Apr 24 19:56:38 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:39 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_h8k102w5devstack@QuobyteHD" returned: 0 in 1.020s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:39 devstack sudo[85468]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353" returned: 0 in 7.057s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:39 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00fc34b-aaba-43d3-92c3-ed4a1056db3e]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:40 devstack sudo[85552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4
Apr 24 19:56:40 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:40 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4" returned: 0 in 0.620s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:40 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4, size 1024.00 MB, duration 7.06 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353 {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 19:56:40 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Converted 1024.00 MB image at 145.08 MB/s
Apr 24 19:56:40 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 19:56:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:40 devstack sudo[85557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353
Apr 24 19:56:40 devstack sudo[85557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:41 devstack sudo[85557]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353" returned: 0 in 0.482s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Lock "cinder-quobyte-c075a927-c3f9-45dc-be05-23d594b7e353" released by "_copy_volume_from_snapshot" :: held 9.715s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Acquiring lock "cinder-quobyte-fe98575a-0057-4cf0-82cf-22946390413c" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Lock "cinder-quobyte-fe98575a-0057-4cf0-82cf-22946390413c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Deleting offline snapshot fe98575a-0057-4cf0-82cf-22946390413c of volume 7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 19:56:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] snapshot_file for this snap is: volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 19:56:41 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09bd02e-f451-417f-934e-4f5bb315bc82]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:41 devstack sudo[85560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c
Apr 24 19:56:41 devstack sudo[85560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:41 devstack sudo[85560]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c" returned: 0 in 0.528s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:56:41 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a9d6fc-535f-4bd6-ad79-8b35e6babef6]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:41 devstack sudo[85565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4
Apr 24 19:56:41 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:42 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4" returned: 0 in 0.524s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:42 devstack sudo[85570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c
Apr 24 19:56:42 devstack sudo[85570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:42 devstack sudo[85570]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c" returned: 0 in 0.557s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:42 devstack sudo[85575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c
Apr 24 19:56:42 devstack sudo[85575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:43 devstack sudo[85575]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4.fe98575a-0057-4cf0-82cf-22946390413c" returned: 0 in 0.458s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Lock "cinder-quobyte-fe98575a-0057-4cf0-82cf-22946390413c" released by "_delete_snapshot" :: held 2.165s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.700s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.637s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1196619995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3690e8-419d-4275-bc50-28e19b7556db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7404448297a4592a2ebed4a739a9570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:29Z,use_quota=True,user_id='44023fb33b2948b590f22558da9d6c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Creating volume 0d3690e8-419d-4275-bc50-28e19b7556db {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:56:43 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:43 devstack sudo[85578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db 1073741824
Apr 24 19:56:43 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:43 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-de82ddb9-ee68-49ec-a8f4-23a4ef418894 tempest-GroupsV314Test-1573003222 None] Create group from source-group-1e110b7f-de2e-48d2-8fd4-5fab7a51aa73 completed successfully.
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Acquiring lock "cinder-quobyte-c075a927-c3f9-45dc-be05-23d594b7e353" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Lock "cinder-quobyte-c075a927-c3f9-45dc-be05-23d594b7e353" acquired by "delete_volume" :: waited 0.025s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[15011b7a-dace-45a1-bd33-08927fcde9e5]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:44 devstack sudo[85583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353
Apr 24 19:56:44 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:44 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db 1073741824" returned: 0 in 0.740s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:44 devstack sudo[85585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db
Apr 24 19:56:44 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:44 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353" returned: 0 in 0.594s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:44 devstack sudo[85591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353
Apr 24 19:56:44 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:44 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db" returned: 0 in 0.527s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.633s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-921661137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bee385a-4674-47e4-8661-79a72fdac105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc185fc1ebf04238a7b73751a10b3a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:31Z,use_quota=True,user_id='d5785a451d664b349b50a776bdd0e3a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Creating volume 0bee385a-4674-47e4-8661-79a72fdac105 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:56:44 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:44 devstack sudo[85593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105 1073741824
Apr 24 19:56:44 devstack sudo[85593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4611cc3-9ca2-48bf-9200-f205a16d11d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3690e8-419d-4275-bc50-28e19b7556db', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd234a8e-9bce-44d2-a08b-7068350e1320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:44 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Volume volume-0d3690e8-419d-4275-bc50-28e19b7556db (0d3690e8-419d-4275-bc50-28e19b7556db): created successfully
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd234a8e-9bce-44d2-a08b-7068350e1320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Flow 'volume_create_manager' (cf6da0fe-95de-49b7-8daf-c89392a99a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:56:44 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-7e9868f2-d68d-4a07-aafb-492051d4ec52 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Created volume successfully.
Apr 24 19:56:45 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c075a927-c3f9-45dc-be05-23d594b7e353" returned: 0 in 0.506s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Lock "cinder-quobyte-c075a927-c3f9-45dc-be05-23d594b7e353" released by "delete_volume" :: held 1.153s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Created reservations ['516a8dc8-fa78-4df0-b68b-3bbcdb7e9155'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:56:45 devstack cinder-volume[81241]: WARNING cinder.quota [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-572500551 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-572500551, it is now deprecated. Please use the default quota class for default quota.
Apr 24 19:56:45 devstack cinder-volume[81241]: WARNING cinder.quota [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-572500551 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-572500551, it is now deprecated. Please use the default quota class for default quota.
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Created reservations ['63869156-faeb-448b-8621-5e0832852ad3', '6456b84a-b835-4656-8d31-9774598d5a9f', '13dfc19a-a37c-45ba-a3e2-f16d2459bf90', 'a3aa634d-9a2f-40c7-8442-33aed554e486'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:45 devstack sudo[85599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:56:45 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:45 devstack sudo[85593]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105 1073741824" returned: 0 in 0.780s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:45 devstack sudo[85601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105
Apr 24 19:56:45 devstack sudo[85601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:45 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.482s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:56:45 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-6582f5f7-0622-4370-9f22-a34c463bff96 tempest-GroupsV314Test-1573003222 None] Delete group completed successfully.
Apr 24 19:56:45 devstack sudo[85601]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105" returned: 0 in 0.506s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.664s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:56:34Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3dc8b8-020b-433f-bee0-6ad362d068f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7076d4b273b94478a8b0caa2b6e338f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:35Z,use_quota=True,user_id='509d147b94704c9cb3c8e99ea2b69578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Creating volume eb3dc8b8-020b-433f-bee0-6ad362d068f5 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:56:45 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:56:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:46 devstack sudo[85605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 1073741824
Apr 24 19:56:46 devstack sudo[85605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:46 devstack cinder-volume[81241]: DEBUG cinder.volume.volume_utils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Attempting download of 8c41cab8-e7de-4393-aaaf-cc39ab149fdd ((None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}])) to volume 0bee385a-4674-47e4-8661-79a72fdac105. {{(pid=81241) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 24 19:56:46 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6069e5f-1205-46e4-a2e3-9cdb288fd658]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7u2923o_ {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:46 devstack sudo[85607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7u2923o_
Apr 24 19:56:46 devstack sudo[85607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Acquiring lock "cinder-quobyte-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Lock "cinder-quobyte-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4" acquired by "delete_volume" :: waited 0.021s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:46 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[64620338-ba86-4e41-8e27-d848c6534e35]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:46 devstack sudo[85612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4
Apr 24 19:56:46 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:46 devstack sudo[85607]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7u2923o_" returned: 0 in 0.586s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7u2923o_ {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:46 devstack sudo[85605]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 1073741824" returned: 0 in 0.737s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:46 devstack sudo[85616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7u2923o_
Apr 24 19:56:46 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:46 devstack sudo[85618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5
Apr 24 19:56:46 devstack sudo[85618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:47 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4" returned: 0 in 0.596s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:47 devstack sudo[85623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4
Apr 24 19:56:47 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:47 devstack sudo[85618]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5" returned: 0 in 0.459s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.801s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:47 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Creating offline snapshot 9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c of volume 0d3690e8-419d-4275-bc50-28e19b7556db {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7u2923o_" returned: 1 in 0.596s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7u2923o_' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG cinder.volume.volume_utils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Attempting download of 8c41cab8-e7de-4393-aaaf-cc39ab149fdd ((None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}])) to volume eb3dc8b8-020b-433f-bee0-6ad362d068f5. {{(pid=81241) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f00c72f-60e7-4cbb-8658-39f07c4ac386]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a414c70-fdbc-4e5b-810a-9f0a7166b2d8]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_f0rwdeyvdevstack@QuobyteHD {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfc02c6-a0fb-4d4c-8d82-2e5581595695]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_65rofsfn {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:47 devstack sudo[85629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db
Apr 24 19:56:47 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:47 devstack sudo[85630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_f0rwdeyvdevstack@QuobyteHD
Apr 24 19:56:47 devstack sudo[85630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:47 devstack sudo[85631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_65rofsfn
Apr 24 19:56:47 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:47 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4" returned: 0 in 0.579s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Lock "cinder-quobyte-7a1e8712-9e2e-4189-ba9b-4ac9a9201aa4" released by "delete_volume" :: held 1.237s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Created reservations ['aefc9252-b0a5-4a72-a170-beb9c7eae351'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Created reservations ['81ff0ccc-8e76-4029-8d68-a179f90a102f', '17c3abb6-35ae-4eaa-a77f-d97c5934ba44', '882815e2-a095-4c38-b9e4-6c3f40ee24a4', '03f525b9-5649-4a13-8e12-eb5b197d0424'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:56:47 devstack sudo[85630]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_f0rwdeyvdevstack@QuobyteHD" returned: 0 in 0.584s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] 8c41cab8-e7de-4393-aaaf-cc39ab149fdd was qcow2, converting to raw {{(pid=81241) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_f0rwdeyvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:47 devstack sudo[85644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_f0rwdeyvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105
Apr 24 19:56:47 devstack sudo[85644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:47 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db" returned: 0 in 0.647s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:47 devstack sudo[85646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c 1G
Apr 24 19:56:47 devstack sudo[85646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:48 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_65rofsfn" returned: 0 in 0.642s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_65rofsfn {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:48 devstack sudo[85648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:56:48 devstack sudo[85648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:48 devstack sudo[85649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_65rofsfn
Apr 24 19:56:48 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:48 devstack sudo[85648]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.597s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:56:48 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-56026a7a-77ce-498e-8b46-89c0056bb734 tempest-GroupsV314Test-1573003222 None] Delete group completed successfully.
Apr 24 19:56:48 devstack sudo[85646]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c 1G" returned: 0 in 0.683s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3690e8-419d-4275-bc50-28e19b7556db -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:48 devstack sudo[85669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3690e8-419d-4275-bc50-28e19b7556db -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c
Apr 24 19:56:48 devstack sudo[85669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:48 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_65rofsfn" returned: 1 in 0.698s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_65rofsfn' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[00af6552-83d4-47bd-b991-da0a59edecc1]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_h8k102w5devstack@QuobyteHD {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:48 devstack sudo[85671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_h8k102w5devstack@QuobyteHD
Apr 24 19:56:48 devstack sudo[85671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:49 devstack sudo[85669]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3690e8-419d-4275-bc50-28e19b7556db -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c" returned: 0 in 0.699s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:49 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c is being set with open permissions: ugo+rw
Apr 24 19:56:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:49 devstack sudo[85680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c
Apr 24 19:56:49 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:49 devstack sudo[85671]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_h8k102w5devstack@QuobyteHD" returned: 0 in 0.734s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:49 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] 8c41cab8-e7de-4393-aaaf-cc39ab149fdd was qcow2, converting to raw {{(pid=81241) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 24 19:56:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_h8k102w5devstack@QuobyteHD /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:49 devstack sudo[85682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_h8k102w5devstack@QuobyteHD /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5
Apr 24 19:56:49 devstack sudo[85682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:49 devstack sudo[85644]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_f0rwdeyvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105" returned: 0 in 1.679s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:49 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_f0rwdeyvdevstack@QuobyteHD, size 112.00 MB, duration 1.68 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105 {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 19:56:49 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Converted 112.00 MB image at 66.62 MB/s
Apr 24 19:56:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:49 devstack sudo[85684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105 1G
Apr 24 19:56:49 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:49 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c" returned: 0 in 0.533s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:49 devstack sudo[85687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.info
Apr 24 19:56:49 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:50 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105 1G" returned: 0 in 0.868s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:50 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f315577-56d5-4476-9326-fb8d147c2718]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:50 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.info" returned: 0 in 0.656s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:50 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.info is being set with open permissions: ugo+rw
Apr 24 19:56:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:50 devstack sudo[85702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.info
Apr 24 19:56:50 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:50 devstack sudo[85701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105
Apr 24 19:56:50 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:51 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.info" returned: 0 in 0.725s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.078s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:51 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0dc1b2cb-7210-4529-9dba-142d43a14950 tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Create snapshot completed successfully
Apr 24 19:56:51 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105" returned: 0 in 0.889s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:51 devstack sudo[85682]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_h8k102w5devstack@QuobyteHD /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5" returned: 0 in 1.959s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:51 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_h8k102w5devstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 19:56:51 devstack cinder-volume[81241]: INFO cinder.image.image_utils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Converted 112.00 MB image at 57.12 MB/s
Apr 24 19:56:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:51 devstack sudo[85709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 1G
Apr 24 19:56:51 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:51 devstack sudo[85708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105
Apr 24 19:56:51 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:52 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105" returned: 1 in 0.680s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.volume.volume_utils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Downloaded image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd ((None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}])) to volume 0bee385a-4674-47e4-8661-79a72fdac105 successfully. {{(pid=81241) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Temporary image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd for user d5785a451d664b349b50a776bdd0e3a8 is deleted. {{(pid=81241) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.volume.volume_utils [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Marking volume 0bee385a-4674-47e4-8661-79a72fdac105 as bootable. {{(pid=81241) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 24 19:56:52 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 1G" returned: 0 in 0.659s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Copying metadata from image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd to 0bee385a-4674-47e4-8661-79a72fdac105. {{(pid=81241) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Creating volume glance metadata for volume 0bee385a-4674-47e4-8661-79a72fdac105 backed by image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81241) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70c6c22-90ee-43f0-bf93-40fa98afbb3d]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0353842-b5fb-4f65-a043-f45a40d04fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bee385a-4674-47e4-8661-79a72fdac105', 'volume_size': 1, 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b862a13976c94661b0ca990e233a527c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'created_at': datetime.datetime(2026, 4, 24, 17, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 48, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f02e7dd5ea0>}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d482972-4c6f-42a9-b3d7-d1e92f5dbe34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Acquiring lock "cinder-9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:52 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Volume volume-0bee385a-4674-47e4-8661-79a72fdac105 (0bee385a-4674-47e4-8661-79a72fdac105): created successfully
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d482972-4c6f-42a9-b3d7-d1e92f5dbe34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Flow 'volume_create_manager' (530f2e3d-77ca-432d-89bb-d38eef709a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "cinder-9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:52 devstack sudo[85718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5
Apr 24 19:56:52 devstack sudo[85718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Acquiring lock "cinder-quobyte-0d3690e8-419d-4275-bc50-28e19b7556db" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:52 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-1f550131-96f5-4f88-baea-2c2443cf6e18 tempest-VolumesImageMetadata-153912108 None] Created volume successfully.
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "cinder-quobyte-0d3690e8-419d-4275-bc50-28e19b7556db" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Acquiring lock "cinder-quobyte-9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "cinder-quobyte-9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Deleting offline snapshot 9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c of volume 0d3690e8-419d-4275-bc50-28e19b7556db {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] snapshot_file for this snap is: volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a743bb-facf-4d2d-87b8-1b148692b5e9]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:52 devstack sudo[85720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c
Apr 24 19:56:52 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Acquiring lock "cinder-0bee385a-4674-47e4-8661-79a72fdac105-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Lock "cinder-0bee385a-4674-47e4-8661-79a72fdac105-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Acquiring lock "cinder-quobyte-0bee385a-4674-47e4-8661-79a72fdac105" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Lock "cinder-quobyte-0bee385a-4674-47e4-8661-79a72fdac105" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:53 devstack sudo[85718]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5" returned: 0 in 0.856s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fe9d15-d2a6-4978-b354-af7c093bd9f1]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:53 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c" returned: 0 in 0.728s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d3690e8-419d-4275-bc50-28e19b7556db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:56:53 devstack sudo[85727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5
Apr 24 19:56:53 devstack sudo[85727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:53 devstack sudo[85728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105
Apr 24 19:56:53 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f131b1-aee6-4f98-9f48-a541a7926677]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:53 devstack sudo[85730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db
Apr 24 19:56:53 devstack sudo[85730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:53 devstack sudo[85727]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5" returned: 1 in 0.673s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG cinder.volume.volume_utils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Downloaded image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd ((None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}])) to volume eb3dc8b8-020b-433f-bee0-6ad362d068f5 successfully. {{(pid=81241) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Temporary image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd for user 509d147b94704c9cb3c8e99ea2b69578 is deleted. {{(pid=81241) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG cinder.volume.volume_utils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Marking volume eb3dc8b8-020b-433f-bee0-6ad362d068f5 as bootable. {{(pid=81241) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Copying metadata from image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd to eb3dc8b8-020b-433f-bee0-6ad362d068f5. {{(pid=81241) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Creating volume glance metadata for volume eb3dc8b8-020b-433f-bee0-6ad362d068f5 backed by image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81241) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 24 19:56:53 devstack sudo[85730]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:53 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db" returned: 0 in 0.604s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105" returned: 0 in 0.713s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:53 devstack sudo[85741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c
Apr 24 19:56:53 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64663d02-d394-412b-983f-fb009b28c0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5', 'volume_size': 1, 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b862a13976c94661b0ca990e233a527c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'created_at': datetime.datetime(2026, 4, 24, 17, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 48, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f02e7877b20>}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba30fda-b6ac-4462-875d-198de757b9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:56:53 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Volume volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 (eb3dc8b8-020b-433f-bee0-6ad362d068f5): created successfully
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba30fda-b6ac-4462-875d-198de757b9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:56:53 devstack sudo[85742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105
Apr 24 19:56:53 devstack sudo[85742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Flow 'volume_create_manager' (c0734a0b-41cf-4a1a-8dcb-89a5e89a0190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:56:53 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-1cd81329-b5b5-47aa-9965-c033790125f4 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Created volume successfully.
Apr 24 19:56:54 devstack sudo[85742]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105" returned: 1 in 0.754s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 19:56:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:54 devstack sudo[85753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105
Apr 24 19:56:54 devstack sudo[85753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:54 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c" returned: 0 in 0.832s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:54 devstack sudo[85755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c
Apr 24 19:56:54 devstack sudo[85755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:55 devstack sudo[85755]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:55 devstack sudo[85753]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db.9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c" returned: 0 in 0.577s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0bee385a-4674-47e4-8661-79a72fdac105" returned: 0 in 0.654s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Lock "cinder-quobyte-0bee385a-4674-47e4-8661-79a72fdac105" released by "delete_volume" :: held 2.253s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "cinder-quobyte-9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c" released by "_delete_snapshot" :: held 2.922s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "cinder-quobyte-0d3690e8-419d-4275-bc50-28e19b7556db" released by "delete_snapshot" :: held 2.963s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:55 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Created reservations ['727c8814-e698-45d6-b666-69b6e6a9cc5f', '6e4dce57-f2e3-45bb-9db6-37d804b64bd5', '818d8a28-edbc-4609-b364-4aeba71f6214', 'fba4a8eb-cb0b-45ec-8ed1-8db5e4b7666d'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:56:55 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Created reservations ['fe8239ff-503e-4c73-b612-8c5f8fa7ccf3', '5cc0a27b-c2e8-487e-8269-9dba42fc76c9', 'd878bf82-8726-4b49-b85f-61a5e6a0f190', '483e8f69-615a-4a37-a53e-68d19e6748f1'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:56:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:55 devstack sudo[85759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:56:55 devstack sudo[85759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:55 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Delete snapshot completed successfully.
Apr 24 19:56:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12268e53-0d24-4624-9106-32ada80bf08d tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "cinder-9d0f3c0f-4f5e-4961-9a5d-8d3cdefb5b7c-delete_snapshot" released by "delete_snapshot" :: held 3.270s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:56 devstack sudo[85759]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.539s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:56 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:56:56 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Deleted volume successfully.
Apr 24 19:56:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-76bfc9d7-3f3f-4c70-a816-186ee787fedb tempest-VolumesImageMetadata-153912108 None] Lock "cinder-0bee385a-4674-47e4-8661-79a72fdac105-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Acquiring lock "cinder-0d3690e8-419d-4275-bc50-28e19b7556db-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "cinder-0d3690e8-419d-4275-bc50-28e19b7556db-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Acquiring lock "cinder-quobyte-0d3690e8-419d-4275-bc50-28e19b7556db" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:56:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "cinder-quobyte-0d3690e8-419d-4275-bc50-28e19b7556db" acquired by "delete_volume" :: waited 0.032s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:56:56 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ec85da-1be7-463b-b6e0-4b6b9a8c0fcf]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:56 devstack sudo[85762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db
Apr 24 19:56:56 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-796572dd-1be5-41dd-b9e6-0c41570143da tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-796572dd-1be5-41dd-b9e6-0c41570143da tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:57 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cf7eb6-0e4c-4753-a2e1-6e1324212221]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:56:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-796572dd-1be5-41dd-b9e6-0c41570143da tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:57 devstack sudo[85772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5
Apr 24 19:56:57 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:57 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db" returned: 0 in 0.748s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:57 devstack sudo[85777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db
Apr 24 19:56:57 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:57 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-796572dd-1be5-41dd-b9e6-0c41570143da tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5" returned: 0 in 0.729s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-796572dd-1be5-41dd-b9e6-0c41570143da tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:58 devstack sudo[85781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5
Apr 24 19:56:58 devstack sudo[85781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:58 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0d3690e8-419d-4275-bc50-28e19b7556db" returned: 0 in 0.733s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "cinder-quobyte-0d3690e8-419d-4275-bc50-28e19b7556db" released by "delete_volume" :: held 1.560s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:56:58 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Created reservations ['ee2a73d4-d724-4f2a-a583-f8cceebb1d3b', '8aff3d86-2b44-40a6-ae29-bdadca1f5953', 'b21b3d40-f78b-4a99-95d3-763b1fcda273', '22a8d0c4-bf9d-4500-b82c-77fc2bf30a91'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:56:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:56:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:56:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:56:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:56:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:56:58 devstack sudo[85784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:56:58 devstack sudo[85784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:56:58 devstack sudo[85781]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-796572dd-1be5-41dd-b9e6-0c41570143da tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5" returned: 1 in 0.844s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-796572dd-1be5-41dd-b9e6-0c41570143da tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 19:56:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-796572dd-1be5-41dd-b9e6-0c41570143da tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.612s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:56:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-796572dd-1be5-41dd-b9e6-0c41570143da tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e', 'name': 'volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad59c6c6-288a-4dbf-a5c6-c8eac2558db6', 'enforce_multipath': True} {{(pid=81241) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 24 19:56:58 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-87ed4b04-0f41-4c89-ae40-cf57f957d1f0 req-796572dd-1be5-41dd-b9e6-0c41570143da tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] attachment_update completed successfully.
Apr 24 19:56:59 devstack sudo[85784]: pam_unix(sudo:session): session closed for user root
Apr 24 19:56:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.889s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:56:59 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:56:59 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Deleted volume successfully.
Apr 24 19:56:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d86146b4-58e4-49f7-8b3d-c6af6c55555b tempest-VolumeSnapshotQuotasNegativeTestJSON-907228361 None] Lock "cinder-0d3690e8-419d-4275-bc50-28e19b7556db-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Flow 'volume_create_manager' (cf035fc7-4b0d-4eef-bc80-c07ad2d40211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ecfd69-d0c9-4d9a-97ef-849d807b2abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ecfd69-d0c9-4d9a-97ef-849d807b2abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2005865348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b44111-08d9-44de-bd16-95ca6c272f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80fb039ca3be4ac5b2e6c7b661dd68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:02Z,use_quota=True,user_id='cc849d74f4eb4d2e8f5cf8db63fb7929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3f0e90-0887-4a10-975a-aecd1ddd4738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3f0e90-0887-4a10-975a-aecd1ddd4738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cda1a6-dad4-4c1a-851b-040b27069406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cda1a6-dad4-4c1a-851b-040b27069406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b44111-08d9-44de-bd16-95ca6c272f1e', 'volume_name': 'volume-32b44111-08d9-44de-bd16-95ca6c272f1e', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e02a3bc-538d-429a-ab92-552694d2d386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e02a3bc-538d-429a-ab92-552694d2d386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b357d107-0289-4ff4-a069-3152b23d9de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:02 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Volume 32b44111-08d9-44de-bd16-95ca6c272f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b44111-08d9-44de-bd16-95ca6c272f1e', 'volume_size': 1}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2005865348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b44111-08d9-44de-bd16-95ca6c272f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80fb039ca3be4ac5b2e6c7b661dd68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:02Z,use_quota=True,user_id='cc849d74f4eb4d2e8f5cf8db63fb7929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Creating volume 32b44111-08d9-44de-bd16-95ca6c272f1e {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:57:02 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:57:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-32b44111-08d9-44de-bd16-95ca6c272f1e 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:02 devstack sudo[85794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-32b44111-08d9-44de-bd16-95ca6c272f1e 1073741824
Apr 24 19:57:02 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:03 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-32b44111-08d9-44de-bd16-95ca6c272f1e 1073741824" returned: 0 in 0.972s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-32b44111-08d9-44de-bd16-95ca6c272f1e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:03 devstack sudo[85802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-32b44111-08d9-44de-bd16-95ca6c272f1e
Apr 24 19:57:03 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:04 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-32b44111-08d9-44de-bd16-95ca6c272f1e" returned: 0 in 0.691s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:57:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b357d107-0289-4ff4-a069-3152b23d9de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b44111-08d9-44de-bd16-95ca6c272f1e', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874736ac-e8a8-4b58-9095-181ab9a940b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:04 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Volume volume-32b44111-08d9-44de-bd16-95ca6c272f1e (32b44111-08d9-44de-bd16-95ca6c272f1e): created successfully
Apr 24 19:57:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874736ac-e8a8-4b58-9095-181ab9a940b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Flow 'volume_create_manager' (cf035fc7-4b0d-4eef-bc80-c07ad2d40211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:04 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c3206718-317b-45f1-832a-077060d025de tempest-VolumesTransfersV355Test-334522814 None] Created volume successfully.
Apr 24 19:57:06 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-003f8483-c426-4970-8f6c-69ebaceb5c74 tempest-VolumesTransfersV355Test-803819134 None] Transfer volume completed successfully.
Apr 24 19:57:08 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Acquiring lock "cinder-32b44111-08d9-44de-bd16-95ca6c272f1e-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:08 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Lock "cinder-32b44111-08d9-44de-bd16-95ca6c272f1e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:08 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Acquiring lock "cinder-quobyte-32b44111-08d9-44de-bd16-95ca6c272f1e" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:08 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Lock "cinder-quobyte-32b44111-08d9-44de-bd16-95ca6c272f1e" acquired by "delete_volume" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:08 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa6bd40-afe9-46a8-bb93-3d7aeacf5a92]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-32b44111-08d9-44de-bd16-95ca6c272f1e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:08 devstack sudo[85849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-32b44111-08d9-44de-bd16-95ca6c272f1e
Apr 24 19:57:08 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:09 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-32b44111-08d9-44de-bd16-95ca6c272f1e" returned: 0 in 1.109s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-32b44111-08d9-44de-bd16-95ca6c272f1e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:09 devstack sudo[85861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-32b44111-08d9-44de-bd16-95ca6c272f1e
Apr 24 19:57:09 devstack sudo[85861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:10 devstack sudo[85861]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-32b44111-08d9-44de-bd16-95ca6c272f1e" returned: 0 in 1.446s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Lock "cinder-quobyte-32b44111-08d9-44de-bd16-95ca6c272f1e" released by "delete_volume" :: held 2.627s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:10 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Created reservations ['e3d59038-0d2e-43bf-ba20-475302f6cb58', 'e63f3f3c-ba97-485b-b498-b5d39dc31783', 'b8179bc0-13cb-4157-8de4-a24db86a491e', '20718d3b-1b3d-4c90-afd3-65cf75ad803b'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:57:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:11 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:11 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:11 devstack sudo[85872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:57:11 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Flow 'volume_create_manager' (476a10aa-69d0-40f6-8fe0-a9bfecacee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ac7d3c-e395-4390-88c5-a69a73a27206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ac7d3c-e395-4390-88c5-a69a73a27206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1473523806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a156202f-4091-4ead-9688-797b5f06d2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80fb039ca3be4ac5b2e6c7b661dd68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:12Z,use_quota=True,user_id='cc849d74f4eb4d2e8f5cf8db63fb7929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629e4c12-4ef5-45b3-9849-630fce60af3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629e4c12-4ef5-45b3-9849-630fce60af3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1c268e-8bd0-42fd-a881-706ce1b7a024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:12 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1c268e-8bd0-42fd-a881-706ce1b7a024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a156202f-4091-4ead-9688-797b5f06d2b1', 'volume_name': 'volume-a156202f-4091-4ead-9688-797b5f06d2b1', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44090d2-f8c0-444e-9700-091bfc5a855d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44090d2-f8c0-444e-9700-091bfc5a855d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a9a740-057f-434d-ba1c-f9c0af505d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:12 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Volume a156202f-4091-4ead-9688-797b5f06d2b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a156202f-4091-4ead-9688-797b5f06d2b1', 'volume_size': 1}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1473523806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a156202f-4091-4ead-9688-797b5f06d2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80fb039ca3be4ac5b2e6c7b661dd68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:12Z,use_quota=True,user_id='cc849d74f4eb4d2e8f5cf8db63fb7929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Creating volume a156202f-4091-4ead-9688-797b5f06d2b1 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:57:12 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a156202f-4091-4ead-9688-797b5f06d2b1 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.552s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:57:12 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Deleted volume successfully.
Apr 24 19:57:12 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-597fe2c9-2dc0-4f01-9809-2e50ad0b7e1d tempest-VolumesTransfersV355Test-1157178822 None] Lock "cinder-32b44111-08d9-44de-bd16-95ca6c272f1e-delete_volume" released by "delete_volume" :: held 4.568s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:12 devstack sudo[85875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a156202f-4091-4ead-9688-797b5f06d2b1 1073741824
Apr 24 19:57:12 devstack sudo[85875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:13 devstack sudo[85875]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a156202f-4091-4ead-9688-797b5f06d2b1 1073741824" returned: 0 in 1.144s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a156202f-4091-4ead-9688-797b5f06d2b1 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:13 devstack sudo[85880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a156202f-4091-4ead-9688-797b5f06d2b1
Apr 24 19:57:13 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:14 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a156202f-4091-4ead-9688-797b5f06d2b1" returned: 0 in 1.002s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:14 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:57:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a9a740-057f-434d-ba1c-f9c0af505d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a156202f-4091-4ead-9688-797b5f06d2b1', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6690fb21-40d9-4ca5-89ec-c78257e3626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:14 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Volume volume-a156202f-4091-4ead-9688-797b5f06d2b1 (a156202f-4091-4ead-9688-797b5f06d2b1): created successfully
Apr 24 19:57:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6690fb21-40d9-4ca5-89ec-c78257e3626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Flow 'volume_create_manager' (476a10aa-69d0-40f6-8fe0-a9bfecacee15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:14 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b5508e76-61eb-46c2-8f49-b97f9c7ab144 tempest-VolumesTransfersV355Test-334522814 None] Created volume successfully.
Apr 24 19:57:16 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Acquiring lock "cinder-a156202f-4091-4ead-9688-797b5f06d2b1-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:16 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Lock "cinder-a156202f-4091-4ead-9688-797b5f06d2b1-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:16 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Acquiring lock "cinder-quobyte-a156202f-4091-4ead-9688-797b5f06d2b1" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:16 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Lock "cinder-quobyte-a156202f-4091-4ead-9688-797b5f06d2b1" acquired by "delete_volume" :: waited 0.028s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:16 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[188df179-b007-4778-97b8-3b0a76480e41]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a156202f-4091-4ead-9688-797b5f06d2b1 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:16 devstack sudo[85921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a156202f-4091-4ead-9688-797b5f06d2b1
Apr 24 19:57:16 devstack sudo[85921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:17 devstack sudo[85921]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a156202f-4091-4ead-9688-797b5f06d2b1" returned: 0 in 0.687s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a156202f-4091-4ead-9688-797b5f06d2b1 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:17 devstack sudo[85936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a156202f-4091-4ead-9688-797b5f06d2b1
Apr 24 19:57:17 devstack sudo[85936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:18 devstack sudo[85936]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a156202f-4091-4ead-9688-797b5f06d2b1" returned: 0 in 0.542s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Lock "cinder-quobyte-a156202f-4091-4ead-9688-797b5f06d2b1" released by "delete_volume" :: held 1.284s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Created reservations ['426123db-a590-44ca-adce-bee7d09b2225', '649a417c-d248-451d-a8e2-0cb0f14c3680', 'dd64768b-560f-4444-ab56-000760d0df43', 'ac4e7586-cc6e-4c74-911b-e5fc23197582'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:18 devstack sudo[85939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:57:18 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Flow 'volume_create_manager' (f5a414d1-c608-4f15-942c-5c8e65c9a566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103a1bd9-d77d-4670-ab6a-fce94e274d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103a1bd9-d77d-4670-ab6a-fce94e274d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-393951320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d504a5-66f7-4c00-89ab-ed886df3ab64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b552c1b699de492081a1f1957b0ae1ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:18Z,use_quota=True,user_id='7e3cc46850004003a9e34450906777aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2681b1-7914-462c-b150-e9333388adae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2681b1-7914-462c-b150-e9333388adae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b363c1e9-f856-496a-9547-89f0a59efc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b363c1e9-f856-496a-9547-89f0a59efc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d504a5-66f7-4c00-89ab-ed886df3ab64', 'volume_name': 'volume-22d504a5-66f7-4c00-89ab-ed886df3ab64', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d05422-a98e-49ad-9011-733adae1fd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d05422-a98e-49ad-9011-733adae1fd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab06d30c-4742-4998-b0f4-84a605d7054c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:18 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Volume 22d504a5-66f7-4c00-89ab-ed886df3ab64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d504a5-66f7-4c00-89ab-ed886df3ab64', 'volume_size': 1}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-393951320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d504a5-66f7-4c00-89ab-ed886df3ab64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b552c1b699de492081a1f1957b0ae1ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:18Z,use_quota=True,user_id='7e3cc46850004003a9e34450906777aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Creating volume 22d504a5-66f7-4c00-89ab-ed886df3ab64 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:57:18 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:18 devstack sudo[85941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64 1073741824
Apr 24 19:57:18 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:18 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.546s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:57:18 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Deleted volume successfully.
Apr 24 19:57:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5a5b373a-2552-481e-a465-b2f5c838aad0 tempest-VolumesTransfersV355Test-1157178822 None] Lock "cinder-a156202f-4091-4ead-9688-797b5f06d2b1-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:19 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64 1073741824" returned: 0 in 0.882s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:19 devstack sudo[85954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64
Apr 24 19:57:19 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:19 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64" returned: 0 in 0.537s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:57:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:19 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab06d30c-4742-4998-b0f4-84a605d7054c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d504a5-66f7-4c00-89ab-ed886df3ab64', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:19 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea97e36-85fd-498e-9a56-c66ab1945903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:19 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Volume volume-22d504a5-66f7-4c00-89ab-ed886df3ab64 (22d504a5-66f7-4c00-89ab-ed886df3ab64): created successfully
Apr 24 19:57:20 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea97e36-85fd-498e-9a56-c66ab1945903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:20 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Flow 'volume_create_manager' (f5a414d1-c608-4f15-942c-5c8e65c9a566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:20 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-cbb99bdb-482b-4492-af46-51a94f7d1381 tempest-SnapshotMetadataTestJSON-1643177267 None] Created volume successfully.
Apr 24 19:57:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] Creating offline snapshot 570acada-aa7c-4327-b529-cb2b4cdfecbd of volume 22d504a5-66f7-4c00-89ab-ed886df3ab64 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 19:57:20 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[60938fe0-81aa-4d64-a419-00353841e969]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:21 devstack sudo[85960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64
Apr 24 19:57:21 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:21 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64" returned: 0 in 0.781s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:21 devstack sudo[85968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd 1G
Apr 24 19:57:21 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:22 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd 1G" returned: 0 in 0.920s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d504a5-66f7-4c00-89ab-ed886df3ab64 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:22 devstack sudo[85984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d504a5-66f7-4c00-89ab-ed886df3ab64 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd
Apr 24 19:57:22 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:23 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d504a5-66f7-4c00-89ab-ed886df3ab64 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd" returned: 0 in 0.672s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:23 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd is being set with open permissions: ugo+rw
Apr 24 19:57:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:23 devstack sudo[86007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd
Apr 24 19:57:23 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 19:57:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:23 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd" returned: 0 in 0.692s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:24 devstack sudo[86025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:57:24 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:24 devstack sudo[86027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.info
Apr 24 19:57:24 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:24 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.884s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:24 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:57:24 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.info" returned: 0 in 0.918s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:24 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.info is being set with open permissions: ugo+rw
Apr 24 19:57:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:25 devstack sudo[86032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.info
Apr 24 19:57:25 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:26 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.info" returned: 0 in 1.399s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.536s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:26 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c3048d26-f5b8-4885-9c42-f9d4a4458e05 tempest-SnapshotMetadataTestJSON-1643177267 None] Create snapshot completed successfully
Apr 24 19:57:26 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Flow 'volume_create_manager' (74672629-2287-4979-8369-341604ade2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7220bab0-83cd-43a9-ae8a-29da412a5fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7220bab0-83cd-43a9-ae8a-29da412a5fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-884650246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990fb05f-04fb-4417-9ade-832f905dacd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8350199b5a074ee2a79389e1a937a2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:27Z,use_quota=True,user_id='27f72281084841d7a8c5346e859c3e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ae4d3c-9050-4f9d-9db8-4b8091adf660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ae4d3c-9050-4f9d-9db8-4b8091adf660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f6a967-fcce-4078-8bd7-0c96d654e828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f6a967-fcce-4078-8bd7-0c96d654e828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '990fb05f-04fb-4417-9ade-832f905dacd9', 'volume_name': 'volume-990fb05f-04fb-4417-9ade-832f905dacd9', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e943b332-55ac-4047-b960-9794b8b7b8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e943b332-55ac-4047-b960-9794b8b7b8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7256bc17-2f02-49a1-81b7-ea5f47e2dd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:27 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Volume 990fb05f-04fb-4417-9ade-832f905dacd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-990fb05f-04fb-4417-9ade-832f905dacd9', 'volume_size': 1}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-884650246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990fb05f-04fb-4417-9ade-832f905dacd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8350199b5a074ee2a79389e1a937a2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:27Z,use_quota=True,user_id='27f72281084841d7a8c5346e859c3e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Creating volume 990fb05f-04fb-4417-9ade-832f905dacd9 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:57:27 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-990fb05f-04fb-4417-9ade-832f905dacd9 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:27 devstack sudo[86053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-990fb05f-04fb-4417-9ade-832f905dacd9 1073741824
Apr 24 19:57:27 devstack sudo[86053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Flow 'volume_create_manager' (1764ee6c-a674-46d4-8b06-76a220fb681f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764f11c6-5ba0-4c43-bfe5-c9bc35188340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764f11c6-5ba0-4c43-bfe5-c9bc35188340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-242921544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0db38e5-62bd-4856-b0fa-5d01adc24169,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='31290650dc9249c2b80820cbbd52cae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:28Z,use_quota=True,user_id='d60db04009e6480489b51af31a4991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55186426-ad28-41f0-af7a-b97eddedc924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55186426-ad28-41f0-af7a-b97eddedc924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084a66f6-0c08-47c7-85ae-33c1a2bfbd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084a66f6-0c08-47c7-85ae-33c1a2bfbd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0db38e5-62bd-4856-b0fa-5d01adc24169', 'volume_name': 'volume-f0db38e5-62bd-4856-b0fa-5d01adc24169', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53af251e-2fe0-46ae-8af9-b79695805abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53af251e-2fe0-46ae-8af9-b79695805abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6795b45d-8404-4d67-8514-68c9872d20aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:27 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Volume f0db38e5-62bd-4856-b0fa-5d01adc24169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0db38e5-62bd-4856-b0fa-5d01adc24169', 'volume_size': 1}
Apr 24 19:57:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:28 devstack sudo[86053]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-990fb05f-04fb-4417-9ade-832f905dacd9 1073741824" returned: 0 in 1.079s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Acquiring lock "cinder-570acada-aa7c-4327-b529-cb2b4cdfecbd-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-990fb05f-04fb-4417-9ade-832f905dacd9 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:28 devstack sudo[86059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-990fb05f-04fb-4417-9ade-832f905dacd9
Apr 24 19:57:28 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "cinder-570acada-aa7c-4327-b529-cb2b4cdfecbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Acquiring lock "cinder-quobyte-22d504a5-66f7-4c00-89ab-ed886df3ab64" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "cinder-quobyte-22d504a5-66f7-4c00-89ab-ed886df3ab64" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Acquiring lock "cinder-quobyte-570acada-aa7c-4327-b529-cb2b4cdfecbd" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "cinder-quobyte-570acada-aa7c-4327-b529-cb2b4cdfecbd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Deleting offline snapshot 570acada-aa7c-4327-b529-cb2b4cdfecbd of volume 22d504a5-66f7-4c00-89ab-ed886df3ab64 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] snapshot_file for this snap is: volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[79453a81-67e9-4609-b4d7-62f0054cd127]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:28 devstack sudo[86061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd
Apr 24 19:57:28 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:28 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-990fb05f-04fb-4417-9ade-832f905dacd9" returned: 0 in 0.474s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.780s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-242921544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0db38e5-62bd-4856-b0fa-5d01adc24169,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='31290650dc9249c2b80820cbbd52cae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:28Z,use_quota=True,user_id='d60db04009e6480489b51af31a4991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Creating volume f0db38e5-62bd-4856-b0fa-5d01adc24169 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:57:28 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f0db38e5-62bd-4856-b0fa-5d01adc24169 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7256bc17-2f02-49a1-81b7-ea5f47e2dd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-990fb05f-04fb-4417-9ade-832f905dacd9', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:28 devstack sudo[86064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f0db38e5-62bd-4856-b0fa-5d01adc24169 1073741824
Apr 24 19:57:28 devstack sudo[86064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997d0a05-8f16-4891-a15e-e7dddd5c44a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:28 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Volume volume-990fb05f-04fb-4417-9ade-832f905dacd9 (990fb05f-04fb-4417-9ade-832f905dacd9): created successfully
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997d0a05-8f16-4891-a15e-e7dddd5c44a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Flow 'volume_create_manager' (74672629-2287-4979-8369-341604ade2fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:28 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d94e91ec-ca0a-478c-9e7a-5ff6814cb455 tempest-VolumesListAdminTestJSON-2080909485 None] Created volume successfully.
Apr 24 19:57:29 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd" returned: 0 in 0.648s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22d504a5-66f7-4c00-89ab-ed886df3ab64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f5f20c-4366-46fa-bcc1-7378d5a681f0]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:29 devstack sudo[86079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64
Apr 24 19:57:29 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Flow 'volume_create_manager' (1417724d-e427-4e44-a2cb-d04667d70677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f9959c-8bbf-4115-afc3-307f27b268ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f9959c-8bbf-4115-afc3-307f27b268ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1118191070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a169750b-0b27-4ea7-a533-cea1c8381e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8350199b5a074ee2a79389e1a937a2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:30Z,use_quota=True,user_id='27f72281084841d7a8c5346e859c3e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07cceb9-c597-44ad-93ed-6b47c354f9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07cceb9-c597-44ad-93ed-6b47c354f9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ec5944-d568-4027-99fa-46376cfbde9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:29 devstack sudo[86064]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ec5944-d568-4027-99fa-46376cfbde9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a169750b-0b27-4ea7-a533-cea1c8381e3c', 'volume_name': 'volume-a169750b-0b27-4ea7-a533-cea1c8381e3c', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce8bd66-d3e5-4584-a597-eb1f5594cbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce8bd66-d3e5-4584-a597-eb1f5594cbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8f7627-55ca-4849-80f2-a3248609f931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:29 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Volume a169750b-0b27-4ea7-a533-cea1c8381e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a169750b-0b27-4ea7-a533-cea1c8381e3c', 'volume_size': 1}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f0db38e5-62bd-4856-b0fa-5d01adc24169 1073741824" returned: 0 in 1.083s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f0db38e5-62bd-4856-b0fa-5d01adc24169 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:29 devstack sudo[86110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f0db38e5-62bd-4856-b0fa-5d01adc24169
Apr 24 19:57:29 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:29 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64" returned: 0 in 0.914s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:29 devstack sudo[86114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd
Apr 24 19:57:29 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:30 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f0db38e5-62bd-4856-b0fa-5d01adc24169" returned: 0 in 0.451s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1118191070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a169750b-0b27-4ea7-a533-cea1c8381e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8350199b5a074ee2a79389e1a937a2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:30Z,use_quota=True,user_id='27f72281084841d7a8c5346e859c3e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Creating volume a169750b-0b27-4ea7-a533-cea1c8381e3c {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:57:30 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a169750b-0b27-4ea7-a533-cea1c8381e3c 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6795b45d-8404-4d67-8514-68c9872d20aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0db38e5-62bd-4856-b0fa-5d01adc24169', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac42448-e269-4a1f-899f-c85ee336c8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:30 devstack sudo[86120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a169750b-0b27-4ea7-a533-cea1c8381e3c 1073741824
Apr 24 19:57:30 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Volume volume-f0db38e5-62bd-4856-b0fa-5d01adc24169 (f0db38e5-62bd-4856-b0fa-5d01adc24169): created successfully
Apr 24 19:57:30 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac42448-e269-4a1f-899f-c85ee336c8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Flow 'volume_create_manager' (1764ee6c-a674-46d4-8b06-76a220fb681f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:30 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-77643320-cdc1-4bbc-bc82-ed523cb62bfb tempest-VolumesGetTest-1780695330 None] Created volume successfully.
Apr 24 19:57:30 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd" returned: 0 in 0.630s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:30 devstack sudo[86129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd
Apr 24 19:57:30 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:31 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:31 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a169750b-0b27-4ea7-a533-cea1c8381e3c 1073741824" returned: 0 in 0.847s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64.570acada-aa7c-4327-b529-cb2b4cdfecbd" returned: 0 in 0.645s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:31 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "cinder-quobyte-570acada-aa7c-4327-b529-cb2b4cdfecbd" released by "_delete_snapshot" :: held 3.011s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a169750b-0b27-4ea7-a533-cea1c8381e3c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:31 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "cinder-quobyte-22d504a5-66f7-4c00-89ab-ed886df3ab64" released by "delete_snapshot" :: held 3.049s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:31 devstack sudo[86151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a169750b-0b27-4ea7-a533-cea1c8381e3c
Apr 24 19:57:31 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:31 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Created reservations ['16c7cce8-37ad-4504-b3eb-6b86f33ca9a9', '0e2c954a-5c8d-4288-b05c-b089ccbeed0e', '1e583bdb-6019-4f05-a573-6a2cbe7f695e', '3da61d58-3db5-47e9-9c35-15ceb7102773'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:57:31 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Delete snapshot completed successfully.
Apr 24 19:57:31 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bdcd33e1-56db-48c3-a0c3-2e0fd4453446 tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "cinder-570acada-aa7c-4327-b529-cb2b4cdfecbd-delete_snapshot" released by "delete_snapshot" :: held 3.248s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:31 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:57:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Flow 'volume_create_manager' (019726c3-f0c6-4020-b230-241bc3178736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567a0913-b3cb-4ec2-b6b2-82082f183e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567a0913-b3cb-4ec2-b6b2-82082f183e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-572361168',display_name='tempest-VolumesGetTest-Volume-438378733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31290650dc9249c2b80820cbbd52cae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:32Z,use_quota=True,user_id='d60db04009e6480489b51af31a4991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d75e98-c29b-485b-a6f3-b4327e0f6463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d75e98-c29b-485b-a6f3-b4327e0f6463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ffe03b-1917-4027-94fe-2189d6a0b6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ffe03b-1917-4027-94fe-2189d6a0b6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e', 'volume_name': 'volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ce0a91-c605-4355-a662-17d829f7d391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ce0a91-c605-4355-a662-17d829f7d391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef21dc24-e670-45d2-a49f-78ea7c1ca2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:32 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Volume df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e', 'volume_size': 1}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:32 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a169750b-0b27-4ea7-a533-cea1c8381e3c" returned: 0 in 0.893s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.207s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-572361168',display_name='tempest-VolumesGetTest-Volume-438378733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31290650dc9249c2b80820cbbd52cae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:32Z,use_quota=True,user_id='d60db04009e6480489b51af31a4991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Creating volume df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:57:32 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:32 devstack sudo[86171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e 1073741824
Apr 24 19:57:32 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8f7627-55ca-4849-80f2-a3248609f931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a169750b-0b27-4ea7-a533-cea1c8381e3c', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71f7a6a-0604-45e3-a708-13c9befeba02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:32 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Volume volume-a169750b-0b27-4ea7-a533-cea1c8381e3c (a169750b-0b27-4ea7-a533-cea1c8381e3c): created successfully
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71f7a6a-0604-45e3-a708-13c9befeba02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Flow 'volume_create_manager' (1417724d-e427-4e44-a2cb-d04667d70677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:32 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-7e307188-77b9-490f-b9ec-cbe4091a5996 tempest-VolumesListAdminTestJSON-2080909485 None] Created volume successfully.
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Acquiring lock "cinder-22d504a5-66f7-4c00-89ab-ed886df3ab64-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "cinder-22d504a5-66f7-4c00-89ab-ed886df3ab64-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Acquiring lock "cinder-quobyte-22d504a5-66f7-4c00-89ab-ed886df3ab64" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "cinder-quobyte-22d504a5-66f7-4c00-89ab-ed886df3ab64" acquired by "delete_volume" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f78e23-bc3c-4a68-9e31-48a1372038f1]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:32 devstack sudo[86176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64
Apr 24 19:57:32 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:33 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e 1073741824" returned: 0 in 0.864s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:33 devstack sudo[86178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e
Apr 24 19:57:33 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Flow 'volume_create_manager' (b3c1031e-a65e-4b02-88cb-d790015db49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f357fce3-800f-4ffb-b1f8-76796e447f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f357fce3-800f-4ffb-b1f8-76796e447f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1812500216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558336fb-6b14-4e15-aefd-f1fb04521223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8350199b5a074ee2a79389e1a937a2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:34Z,use_quota=True,user_id='27f72281084841d7a8c5346e859c3e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424427e2-eb77-4739-9176-128f47d0a970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424427e2-eb77-4739-9176-128f47d0a970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b4b2b2-1810-4818-a15a-b389309eb1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b4b2b2-1810-4818-a15a-b389309eb1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '558336fb-6b14-4e15-aefd-f1fb04521223', 'volume_name': 'volume-558336fb-6b14-4e15-aefd-f1fb04521223', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa6988f-bbc5-4269-a52a-a116eab8b504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa6988f-bbc5-4269-a52a-a116eab8b504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee021ccf-4121-4754-9787-97c1a264b410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:33 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Volume 558336fb-6b14-4e15-aefd-f1fb04521223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-558336fb-6b14-4e15-aefd-f1fb04521223', 'volume_size': 1}
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:33 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64" returned: 0 in 1.026s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:33 devstack sudo[86184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64
Apr 24 19:57:33 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:34 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e" returned: 0 in 0.965s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1812500216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558336fb-6b14-4e15-aefd-f1fb04521223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8350199b5a074ee2a79389e1a937a2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:34Z,use_quota=True,user_id='27f72281084841d7a8c5346e859c3e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Creating volume 558336fb-6b14-4e15-aefd-f1fb04521223 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:57:34 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-558336fb-6b14-4e15-aefd-f1fb04521223 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef21dc24-e670-45d2-a49f-78ea7c1ca2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b57b901-f5cb-41fa-bf55-871b4c97e07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:34 devstack sudo[86188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-558336fb-6b14-4e15-aefd-f1fb04521223 1073741824
Apr 24 19:57:34 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:34 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Volume volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e (df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e): created successfully
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b57b901-f5cb-41fa-bf55-871b4c97e07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Flow 'volume_create_manager' (019726c3-f0c6-4020-b230-241bc3178736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:34 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b4d3e226-6a32-49a5-830f-43f01d72c555 tempest-VolumesGetTest-1780695330 None] Created volume successfully.
Apr 24 19:57:34 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-22d504a5-66f7-4c00-89ab-ed886df3ab64" returned: 0 in 0.764s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "cinder-quobyte-22d504a5-66f7-4c00-89ab-ed886df3ab64" released by "delete_volume" :: held 1.858s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Created reservations ['ec53dc3f-85ab-4b7e-b987-fa6f3f73ba35', '48f76c3a-c7bf-4699-acb4-c89af62cd403', 'd4fb14df-8780-4c5c-b185-4ecf53ac6f8a', '418565c6-ccf4-4df7-a6c2-7c53aee6e667'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:34 devstack sudo[86191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:57:34 devstack sudo[86191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:35 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-558336fb-6b14-4e15-aefd-f1fb04521223 1073741824" returned: 0 in 0.955s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-558336fb-6b14-4e15-aefd-f1fb04521223 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:35 devstack sudo[86203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-558336fb-6b14-4e15-aefd-f1fb04521223
Apr 24 19:57:35 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:35 devstack sudo[86191]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.704s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:35 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:57:35 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Deleted volume successfully.
Apr 24 19:57:35 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-920a8828-6c73-418c-9395-ceb11bb5992c tempest-SnapshotMetadataTestJSON-1643177267 None] Lock "cinder-22d504a5-66f7-4c00-89ab-ed886df3ab64-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:35 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:35 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Lock "cinder-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:35 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-quobyte-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:35 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e" acquired by "delete_volume" :: waited 0.027s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:35 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[033f053b-d5d3-41d8-a28b-2d42c7cbffbe]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:35 devstack sudo[86228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e
Apr 24 19:57:35 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:36 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-558336fb-6b14-4e15-aefd-f1fb04521223" returned: 0 in 0.887s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:36 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:57:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:36 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee021ccf-4121-4754-9787-97c1a264b410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-558336fb-6b14-4e15-aefd-f1fb04521223', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:36 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27813905-e1e5-437d-8f42-f4cf77100381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:36 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Volume volume-558336fb-6b14-4e15-aefd-f1fb04521223 (558336fb-6b14-4e15-aefd-f1fb04521223): created successfully
Apr 24 19:57:36 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27813905-e1e5-437d-8f42-f4cf77100381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:36 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Flow 'volume_create_manager' (b3c1031e-a65e-4b02-88cb-d790015db49a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:36 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-36603c8d-5521-4450-a18d-d2e2330c5bce tempest-VolumesListAdminTestJSON-2080909485 None] Created volume successfully.
Apr 24 19:57:36 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e" returned: 0 in 0.761s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:36 devstack sudo[86236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e
Apr 24 19:57:36 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:37 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e" returned: 0 in 0.609s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e" released by "delete_volume" :: held 1.447s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Created reservations ['cf36561e-6cd6-49bf-bd8e-080a9fd67626', '06240f63-74d7-4b39-aaab-d7cb3fc5709f', '642ed5ff-9f52-4ce1-9a3d-a43cf497a773', '0f92ff33-352b-403f-a4dc-6b17c469fcfd'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:37 devstack sudo[86240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:57:37 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Flow 'volume_create_manager' (6f9fb9b5-2841-451f-8e99-5b324887e9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1d88d6-6d9f-4eba-933a-30e00087a651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1d88d6-6d9f-4eba-933a-30e00087a651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36dca4c1-016b-47a4-b56a-5c9dd8984dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa90850a078f41d584d5262b690a8ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:38Z,use_quota=True,user_id='5b2693bf3e4e4317a7e389dd7477d65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1610b8-6181-4f25-b556-0839d1839e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1610b8-6181-4f25-b556-0839d1839e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c524c59-2077-43e3-bcd7-9058070f6c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c524c59-2077-43e3-bcd7-9058070f6c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36dca4c1-016b-47a4-b56a-5c9dd8984dbc', 'volume_name': 'volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1526fe6f-6ced-4190-afd6-52b4e3c4ef95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1526fe6f-6ced-4190-afd6-52b4e3c4ef95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba73614d-3bb9-496e-8e6d-711e65f8931b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:37 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Volume 36dca4c1-016b-47a4-b56a-5c9dd8984dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc', 'volume_size': 1}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36dca4c1-016b-47a4-b56a-5c9dd8984dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa90850a078f41d584d5262b690a8ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:38Z,use_quota=True,user_id='5b2693bf3e4e4317a7e389dd7477d65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Creating volume 36dca4c1-016b-47a4-b56a-5c9dd8984dbc {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:57:37 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:57:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:37 devstack sudo[86266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc 1073741824
Apr 24 19:57:37 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-f0db38e5-62bd-4856-b0fa-5d01adc24169-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Lock "cinder-f0db38e5-62bd-4856-b0fa-5d01adc24169-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-quobyte-f0db38e5-62bd-4856-b0fa-5d01adc24169" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-f0db38e5-62bd-4856-b0fa-5d01adc24169" acquired by "delete_volume" :: waited 0.034s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:38 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e4e9a0-f9cb-4acd-81a1-8bed3caf6781]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f0db38e5-62bd-4856-b0fa-5d01adc24169 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:38 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.928s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:38 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:57:38 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Deleted volume successfully.
Apr 24 19:57:38 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:INSERT=40,cinder:UPDATE=113,cinder:SELECT=110,cinder:DELETE=11 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:57:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5582df86-bf4c-4585-903b-9d47152dfa30 tempest-VolumesGetTest-1780695330 None] Lock "cinder-df71a4c4-4f6a-4ece-a66e-09d1ad3aa58e-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:38 devstack sudo[86280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f0db38e5-62bd-4856-b0fa-5d01adc24169
Apr 24 19:57:38 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:38 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:UPDATE=134,cinder:SELECT=107,cinder:INSERT=40,cinder:DELETE=8 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:57:38 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-ece535ea-28c2-4747-aa7f-e05353c8fa3d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Terminate volume connection completed successfully.
Apr 24 19:57:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-ece535ea-28c2-4747-aa7f-e05353c8fa3d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Deleting attachment ad59c6c6-288a-4dbf-a5c6-c8eac2558db6. {{(pid=81241) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 24 19:57:38 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc 1073741824" returned: 0 in 0.953s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:38 devstack sudo[86290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc
Apr 24 19:57:38 devstack sudo[86290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:38 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f0db38e5-62bd-4856-b0fa-5d01adc24169" returned: 0 in 0.756s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f0db38e5-62bd-4856-b0fa-5d01adc24169 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:39 devstack sudo[86292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f0db38e5-62bd-4856-b0fa-5d01adc24169
Apr 24 19:57:39 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Acquiring lock "cinder-eb3dc8b8-020b-433f-bee0-6ad362d068f5-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "cinder-eb3dc8b8-020b-433f-bee0-6ad362d068f5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:39 devstack sudo[86290]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc" returned: 0 in 0.604s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Acquiring lock "cinder-quobyte-eb3dc8b8-020b-433f-bee0-6ad362d068f5" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba73614d-3bb9-496e-8e6d-711e65f8931b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e85e6c-9be6-4b04-a63b-3c478ffa17be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "cinder-quobyte-eb3dc8b8-020b-433f-bee0-6ad362d068f5" acquired by "delete_volume" :: waited 0.042s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:39 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Volume volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc (36dca4c1-016b-47a4-b56a-5c9dd8984dbc): created successfully
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e85e6c-9be6-4b04-a63b-3c478ffa17be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Flow 'volume_create_manager' (6f9fb9b5-2841-451f-8e99-5b324887e9cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:39 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f8abb458-aae6-4c72-859e-8d98b7301462 tempest-VolumesListAdminTestJSON-1406985649 None] Created volume successfully.
Apr 24 19:57:39 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89c507d-978e-4d25-b889-44f849f9e514]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f0db38e5-62bd-4856-b0fa-5d01adc24169" returned: 0 in 0.675s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-f0db38e5-62bd-4856-b0fa-5d01adc24169" released by "delete_volume" :: held 1.513s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Created reservations ['57598e0d-97bd-4bb8-873b-688515e246d4', 'd41f7c8e-fbe8-401a-8c35-fb34023e9553', '8bfebb10-2078-41d8-ac12-1b35f631bab1', 'ced19247-a617-4234-8372-e6653a21b798'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:57:39 devstack sudo[86297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5
Apr 24 19:57:39 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:39 devstack sudo[86299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:57:39 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Acquiring lock "cinder-36dca4c1-016b-47a4-b56a-5c9dd8984dbc-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Lock "cinder-36dca4c1-016b-47a4-b56a-5c9dd8984dbc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Acquiring lock "cinder-quobyte-36dca4c1-016b-47a4-b56a-5c9dd8984dbc" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Lock "cinder-quobyte-36dca4c1-016b-47a4-b56a-5c9dd8984dbc" acquired by "delete_volume" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "cinder-558336fb-6b14-4e15-aefd-f1fb04521223-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[060d42d6-f9bc-4753-aa0f-dd5aff43ab4d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Lock "cinder-558336fb-6b14-4e15-aefd-f1fb04521223-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "cinder-quobyte-558336fb-6b14-4e15-aefd-f1fb04521223" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Lock "cinder-quobyte-558336fb-6b14-4e15-aefd-f1fb04521223" acquired by "delete_volume" :: waited 0.025s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92af46a-0090-4fa2-8c4d-5d727728df2d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-558336fb-6b14-4e15-aefd-f1fb04521223 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:40 devstack sudo[86301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc
Apr 24 19:57:40 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:40 devstack sudo[86302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-558336fb-6b14-4e15-aefd-f1fb04521223
Apr 24 19:57:40 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:40 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:40 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.026s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Flow 'volume_create_manager' (dd0376c3-e6e6-4dc4-9162-0585d74badb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77627854-7a87-4f34-bb72-5d60ee4547d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5" returned: 0 in 1.237s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:40 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Deleted volume successfully.
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77627854-7a87-4f34-bb72-5d60ee4547d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1994662634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a596afd-d8c5-4284-b82b-84cd4e05c662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31290650dc9249c2b80820cbbd52cae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:41Z,use_quota=True,user_id='d60db04009e6480489b51af31a4991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57e85cc-c7ad-471e-8c7f-431f1cf09245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57e85cc-c7ad-471e-8c7f-431f1cf09245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85486029-a457-4e36-b0cd-1cc822838166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85486029-a457-4e36-b0cd-1cc822838166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a596afd-d8c5-4284-b82b-84cd4e05c662', 'volume_name': 'volume-4a596afd-d8c5-4284-b82b-84cd4e05c662', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ad8c27-d1df-4a86-a9ad-eefcb3684fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:41 devstack sudo[86308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5
Apr 24 19:57:41 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ad8c27-d1df-4a86-a9ad-eefcb3684fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572ac997-bb86-4997-b14d-f0123dd9ee1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:41 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Volume 4a596afd-d8c5-4284-b82b-84cd4e05c662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a596afd-d8c5-4284-b82b-84cd4e05c662', 'volume_size': 1}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1994662634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a596afd-d8c5-4284-b82b-84cd4e05c662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31290650dc9249c2b80820cbbd52cae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:41Z,use_quota=True,user_id='d60db04009e6480489b51af31a4991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Creating volume 4a596afd-d8c5-4284-b82b-84cd4e05c662 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:57:41 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-fb3b922d-9f4c-4a07-bf1b-2444f5d0f7de tempest-VolumesGetTest-1780695330 None] Lock "cinder-f0db38e5-62bd-4856-b0fa-5d01adc24169-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:41 devstack sudo[86312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 1073741824
Apr 24 19:57:41 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:41 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc" returned: 0 in 0.993s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:41 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-558336fb-6b14-4e15-aefd-f1fb04521223" returned: 0 in 0.895s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:41 devstack sudo[86318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-558336fb-6b14-4e15-aefd-f1fb04521223 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:41 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:41 devstack sudo[86320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-558336fb-6b14-4e15-aefd-f1fb04521223
Apr 24 19:57:41 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:41 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5" returned: 1 in 0.839s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:41 devstack sudo[86327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5
Apr 24 19:57:41 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:41 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-36dca4c1-016b-47a4-b56a-5c9dd8984dbc" returned: 0 in 0.640s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Lock "cinder-quobyte-36dca4c1-016b-47a4-b56a-5c9dd8984dbc" released by "delete_volume" :: held 1.736s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Created reservations ['96e24a4b-f552-4102-aee2-2fbba82eef4d', '39b2bd1e-ca9e-4965-9b16-d45ff61db4da', '87456fff-993c-446f-a649-3def733cca3d', '89796978-d18c-4f39-bcc0-4bb3483888d5'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:42 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-558336fb-6b14-4e15-aefd-f1fb04521223" returned: 0 in 0.917s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:42 devstack sudo[86332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:57:42 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Lock "cinder-quobyte-558336fb-6b14-4e15-aefd-f1fb04521223" released by "delete_volume" :: held 1.865s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:42 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 1073741824" returned: 0 in 1.182s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Created reservations ['6fcdce03-a7e9-4f4a-b1d2-0b8584eeea4f', '7e535a04-0d68-45fd-a72a-a3d14ab22e58', 'e4e8d37a-3eb4-4e43-be95-0e83b41468b7', '9977e4ea-083d-49bf-bee2-c343c4b59d5f'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:57:42 devstack sudo[86334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662
Apr 24 19:57:42 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:42 devstack sudo[86337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:57:42 devstack sudo[86337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "cinder-a169750b-0b27-4ea7-a533-cea1c8381e3c-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Lock "cinder-a169750b-0b27-4ea7-a533-cea1c8381e3c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:42 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eb3dc8b8-020b-433f-bee0-6ad362d068f5" returned: 0 in 1.192s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "cinder-quobyte-eb3dc8b8-020b-433f-bee0-6ad362d068f5" released by "delete_volume" :: held 3.381s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "cinder-quobyte-a169750b-0b27-4ea7-a533-cea1c8381e3c" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Lock "cinder-quobyte-a169750b-0b27-4ea7-a533-cea1c8381e3c" acquired by "delete_volume" :: waited 0.025s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efe4323-7c18-4cc2-a3a9-613bc5d00a6f]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a169750b-0b27-4ea7-a533-cea1c8381e3c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:43 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.977s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:57:43 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Deleted volume successfully.
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG cinder.quota [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Created reservations ['d4070997-2182-496e-a2e1-1b0b10ae7731', '0175aed7-8d5e-403f-8940-65fec6deeb36', 'a552901b-50e0-47e3-a0db-cbcdd82ccd70', 'c95b0fc0-6d55-48b3-8157-0409e97ae580'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:57:43 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-21d7cd73-cc5c-4dbb-af71-baca1a07a533 tempest-VolumesListAdminTestJSON-1406985649 None] Lock "cinder-36dca4c1-016b-47a4-b56a-5c9dd8984dbc-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662" returned: 0 in 0.937s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:43 devstack sudo[86342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a169750b-0b27-4ea7-a533-cea1c8381e3c
Apr 24 19:57:43 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572ac997-bb86-4997-b14d-f0123dd9ee1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a596afd-d8c5-4284-b82b-84cd4e05c662', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6dc0f9-7fc7-448f-be92-e81c654de8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:43 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Volume volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 (4a596afd-d8c5-4284-b82b-84cd4e05c662): created successfully
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6dc0f9-7fc7-448f-be92-e81c654de8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Flow 'volume_create_manager' (dd0376c3-e6e6-4dc4-9162-0585d74badb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:43 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b44db7cb-c6e4-4397-b8ec-e7e03045019d tempest-VolumesGetTest-1780695330 None] Created volume successfully.
Apr 24 19:57:43 devstack sudo[86345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:57:43 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:43 devstack sudo[86337]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.956s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:57:43 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Deleted volume successfully.
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a51dbc76-2d1b-4464-a11a-a48b6ca90dea tempest-VolumesListAdminTestJSON-2080909485 None] Lock "cinder-558336fb-6b14-4e15-aefd-f1fb04521223-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:43 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a169750b-0b27-4ea7-a533-cea1c8381e3c" returned: 0 in 0.806s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a169750b-0b27-4ea7-a533-cea1c8381e3c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:43 devstack sudo[86352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a169750b-0b27-4ea7-a533-cea1c8381e3c
Apr 24 19:57:43 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:44 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.641s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:44 devstack cinder-volume[81241]: DEBUG cinder.manager [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:57:44 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Deleted volume successfully.
Apr 24 19:57:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-1a2b5cfc-f83c-4e9a-8a32-56cbadb25c10 req-950ca57f-da6c-498e-a7b9-141f6d0ecf09 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "cinder-eb3dc8b8-020b-433f-bee0-6ad362d068f5-delete_volume" released by "delete_volume" :: held 4.581s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:44 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a169750b-0b27-4ea7-a533-cea1c8381e3c" returned: 0 in 0.913s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Lock "cinder-quobyte-a169750b-0b27-4ea7-a533-cea1c8381e3c" released by "delete_volume" :: held 1.780s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:44 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:57:44 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Created reservations ['753e09d9-133c-4672-9ee3-78c4ca7dab75', 'c252ecc9-5998-4a84-bd73-0539c8053c07', '50d27608-110b-445d-94a9-0d3d6564c7c9', 'bbf0ad08-9cc1-4cb5-9647-63d8e7228d6d'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:57:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Flow 'volume_create_manager' (7ccbc45a-642e-4e1f-a5a8-4439d7bd365b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1a6edc-84f8-4189-bc6e-5fc00cfa79dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Flow 'volume_create_manager' (439114f8-90fb-408f-9565-b78d389dbc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2b2f09-b8eb-48ad-b5c8-44872a6ac8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1a6edc-84f8-4189-bc6e-5fc00cfa79dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1993716160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2b39d6-a57f-4b43-8b04-af422fd3d1b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='31290650dc9249c2b80820cbbd52cae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=4a596afd-d8c5-4284-b82b-84cd4e05c662,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:45Z,use_quota=True,user_id='d60db04009e6480489b51af31a4991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889448e8-b766-497b-aec5-6f62fe5f0930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889448e8-b766-497b-aec5-6f62fe5f0930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3b9273-d6de-49fc-93ae-584d3287e0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2b2f09-b8eb-48ad-b5c8-44872a6ac8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1834434756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28882fa-4481-4408-b3d2-78faa1b951ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5b3952a0974218a1283a74954a664b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:45Z,use_quota=True,user_id='f40e03d34f0a45de913283e4c652a13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1bae9c-0a6e-48ea-bae4-c591176f8347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1bae9c-0a6e-48ea-bae4-c591176f8347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2859c31-0ca7-49cc-88f7-dda41219f8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2859c31-0ca7-49cc-88f7-dda41219f8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28882fa-4481-4408-b3d2-78faa1b951ea', 'volume_name': 'volume-f28882fa-4481-4408-b3d2-78faa1b951ea', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a109cb2-7860-418e-a046-0b05073ef3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a109cb2-7860-418e-a046-0b05073ef3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a650eb0-c48b-4a42-9ed2-624e4992eb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:45 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Volume f28882fa-4481-4408-b3d2-78faa1b951ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28882fa-4481-4408-b3d2-78faa1b951ea', 'volume_size': 1}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1834434756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28882fa-4481-4408-b3d2-78faa1b951ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5b3952a0974218a1283a74954a664b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:45Z,use_quota=True,user_id='f40e03d34f0a45de913283e4c652a13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Creating volume f28882fa-4481-4408-b3d2-78faa1b951ea {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:57:45 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f28882fa-4481-4408-b3d2-78faa1b951ea 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:45 devstack sudo[86387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f28882fa-4481-4408-b3d2-78faa1b951ea 1073741824
Apr 24 19:57:45 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3b9273-d6de-49fc-93ae-584d3287e0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3c2b39d6-a57f-4b43-8b04-af422fd3d1b1', 'volume_name': 'volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1', 'volume_size': 1, 'source_volid': '4a596afd-d8c5-4284-b82b-84cd4e05c662', 'source_volstatus': 'available'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271698a0-1bae-4cb1-8439-2c2f63dcc00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271698a0-1bae-4cb1-8439-2c2f63dcc00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9fba8d8-66d4-43fe-9589-a56473c698b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:45 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Volume 3c2b39d6-a57f-4b43-8b04-af422fd3d1b1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1', 'volume_size': 1, 'source_volid': '4a596afd-d8c5-4284-b82b-84cd4e05c662', 'source_volstatus': 'available'}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:45 devstack sudo[86389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:57:45 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:45 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.495s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:57:45 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Deleted volume successfully.
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2b326c40-b776-4f4f-bb87-0186f5080b01 tempest-VolumesListAdminTestJSON-2080909485 None] Lock "cinder-a169750b-0b27-4ea7-a533-cea1c8381e3c-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:45 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f28882fa-4481-4408-b3d2-78faa1b951ea 1073741824" returned: 0 in 0.649s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f28882fa-4481-4408-b3d2-78faa1b951ea {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:45 devstack sudo[86396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f28882fa-4481-4408-b3d2-78faa1b951ea
Apr 24 19:57:45 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "cinder-990fb05f-04fb-4417-9ade-832f905dacd9-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Lock "cinder-990fb05f-04fb-4417-9ade-832f905dacd9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "cinder-quobyte-990fb05f-04fb-4417-9ade-832f905dacd9" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Lock "cinder-quobyte-990fb05f-04fb-4417-9ade-832f905dacd9" acquired by "delete_volume" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dfa290-4fd2-4260-8a3b-df5f77d95db1]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-990fb05f-04fb-4417-9ade-832f905dacd9 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:46 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f28882fa-4481-4408-b3d2-78faa1b951ea" returned: 0 in 0.591s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.207s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:46 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Cloning volume 4a596afd-d8c5-4284-b82b-84cd4e05c662 to volume 3c2b39d6-a57f-4b43-8b04-af422fd3d1b1
Apr 24 19:57:46 devstack sudo[86399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-990fb05f-04fb-4417-9ade-832f905dacd9
Apr 24 19:57:46 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a650eb0-c48b-4a42-9ed2-624e4992eb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28882fa-4481-4408-b3d2-78faa1b951ea', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11caf9f7-466c-4d8c-ab30-e4373eeab6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:46 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Volume volume-f28882fa-4481-4408-b3d2-78faa1b951ea (f28882fa-4481-4408-b3d2-78faa1b951ea): created successfully
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11caf9f7-466c-4d8c-ab30-e4373eeab6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Flow 'volume_create_manager' (439114f8-90fb-408f-9565-b78d389dbc56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Creating offline snapshot 57ed19e9-72f1-4a5f-9430-d24f8b383ae4 of volume 4a596afd-d8c5-4284-b82b-84cd4e05c662 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 19:57:46 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-81a347cf-a99a-41f2-8b9a-b0ae48091a44 tempest-VolumesTransfersV357Test-1352225935 None] Created volume successfully.
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1f275f-5017-4377-a18f-7a185e29691a]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:46 devstack sudo[86403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662
Apr 24 19:57:46 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:46 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-990fb05f-04fb-4417-9ade-832f905dacd9" returned: 0 in 0.635s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-990fb05f-04fb-4417-9ade-832f905dacd9 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:47 devstack sudo[86408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-990fb05f-04fb-4417-9ade-832f905dacd9
Apr 24 19:57:47 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:47 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662" returned: 0 in 0.612s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:47 devstack sudo[86413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4 1G
Apr 24 19:57:47 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:47 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-990fb05f-04fb-4417-9ade-832f905dacd9" returned: 0 in 0.636s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:47 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Lock "cinder-quobyte-990fb05f-04fb-4417-9ade-832f905dacd9" released by "delete_volume" :: held 1.326s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:47 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e13a9dcb-c77c-48dd-895e-b422b172c593 tempest-VolumesTransfersV357Test-994316763 None] Transfer volume completed successfully.
Apr 24 19:57:47 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Created reservations ['d6cd7823-6e99-488d-b358-e92812dad681', '2ddb72ac-572b-408c-b3e3-ac478866119d', 'cebb030c-6a12-4ca8-bcb9-ef0f87d0fbed', '964b95c7-ce24-4787-8ff6-a54ed23ee4e9'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:57:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:47 devstack sudo[86419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:57:47 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:47 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4 1G" returned: 0 in 0.724s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:47 devstack sudo[86421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4
Apr 24 19:57:47 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:48 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.545s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:48 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:57:48 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Deleted volume successfully.
Apr 24 19:57:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad91e3e8-9c2a-41ca-b141-989fbab6772b tempest-VolumesListAdminTestJSON-2080909485 None] Lock "cinder-990fb05f-04fb-4417-9ade-832f905dacd9-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:48 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4" returned: 0 in 0.609s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:48 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4 is being set with open permissions: ugo+rw
Apr 24 19:57:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:48 devstack sudo[86427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4
Apr 24 19:57:48 devstack sudo[86427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Acquiring lock "cinder-f28882fa-4481-4408-b3d2-78faa1b951ea-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Lock "cinder-f28882fa-4481-4408-b3d2-78faa1b951ea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Acquiring lock "cinder-quobyte-f28882fa-4481-4408-b3d2-78faa1b951ea" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Lock "cinder-quobyte-f28882fa-4481-4408-b3d2-78faa1b951ea" acquired by "delete_volume" :: waited 0.023s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:48 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ca5040-bfd3-44f6-8cfa-98b3e4ceec69]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f28882fa-4481-4408-b3d2-78faa1b951ea {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:48 devstack sudo[86430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f28882fa-4481-4408-b3d2-78faa1b951ea
Apr 24 19:57:48 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:49 devstack sudo[86427]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4" returned: 0 in 0.567s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:49 devstack sudo[86434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.info
Apr 24 19:57:49 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:49 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f28882fa-4481-4408-b3d2-78faa1b951ea" returned: 0 in 0.718s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f28882fa-4481-4408-b3d2-78faa1b951ea {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:49 devstack sudo[86439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f28882fa-4481-4408-b3d2-78faa1b951ea
Apr 24 19:57:49 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:49 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.info" returned: 0 in 0.604s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:49 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.info is being set with open permissions: ugo+rw
Apr 24 19:57:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:49 devstack sudo[86442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.info
Apr 24 19:57:49 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:50 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f28882fa-4481-4408-b3d2-78faa1b951ea" returned: 0 in 0.552s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Lock "cinder-quobyte-f28882fa-4481-4408-b3d2-78faa1b951ea" released by "delete_volume" :: held 1.327s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Created reservations ['6a50c912-4d88-4f20-96c9-9bb69e63f86e', '44292875-9a7d-42ce-bcf6-2a078580a3a7', '7de3a44f-98a1-49e2-8388-fd46c19e455f', 'fdcaf81d-e161-4c04-8157-64bae12c6d2e'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:50 devstack sudo[86446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:57:50 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:50 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.info" returned: 0 in 0.602s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-quobyte-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1" by "_copy_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] snapshot: 57ed19e9-72f1-4a5f-9430-d24f8b383ae4, volume: 3c2b39d6-a57f-4b43-8b04-af422fd3d1b1,  {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cffe462-bee9-4ee5-87ee-6213c073354b]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:50 devstack sudo[86448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4
Apr 24 19:57:50 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:50 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.621s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:57:50 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Deleted volume successfully.
Apr 24 19:57:50 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-40f1176f-0fef-4c04-b1ad-88a40e829c45 tempest-VolumesTransfersV357Test-962956248 None] Lock "cinder-f28882fa-4481-4408-b3d2-78faa1b951ea-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:51 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4" returned: 0 in 0.832s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a596afd-d8c5-4284-b82b-84cd4e05c662(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Creating direct copy from snapshot {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[949d856a-14dc-477d-b032-97004490bb1e]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:51 devstack sudo[86455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662
Apr 24 19:57:51 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Flow 'volume_create_manager' (569ce905-9098-42be-8630-972c1aebbb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd40c5e5-8628-47e3-a6d9-2a724ea4ee41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd40c5e5-8628-47e3-a6d9-2a724ea4ee41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-371650175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef340d5e-a11c-40e6-a384-682d4a8be58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5b3952a0974218a1283a74954a664b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:51Z,use_quota=True,user_id='f40e03d34f0a45de913283e4c652a13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d71887-3586-4d84-869f-74e69fc0878a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d71887-3586-4d84-869f-74e69fc0878a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fddfeaa2-4c50-49ad-ba04-92626616ba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fddfeaa2-4c50-49ad-ba04-92626616ba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef340d5e-a11c-40e6-a384-682d4a8be58b', 'volume_name': 'volume-ef340d5e-a11c-40e6-a384-682d4a8be58b', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37bd08e2-1e21-4837-92e0-afe1b08dd3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37bd08e2-1e21-4837-92e0-afe1b08dd3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c33029-228a-4ec0-b5f3-703478c5f2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:51 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Volume ef340d5e-a11c-40e6-a384-682d4a8be58b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef340d5e-a11c-40e6-a384-682d4a8be58b', 'volume_size': 1}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:51 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662" returned: 0 in 0.606s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG cinder.utils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Path /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1 not found in is_blk_device check {{(pid=81241) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 19:57:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:51 devstack sudo[86460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1
Apr 24 19:57:51 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:54 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:57:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Flow 'volume_create_manager' (bf121a9e-045a-493e-82b2-394ee510048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:57:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b7a0aa-433b-457d-b771-6b8f77c28a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b7a0aa-433b-457d-b771-6b8f77c28a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-440707232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd314e3a-bdf0-4516-ba8e-da7bc9801efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7aecbffac9b4862bbab9a4057f2c050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:55Z,use_quota=True,user_id='79db5b50b8c44bab9060a64406bb8fab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0d613f-82ba-4c43-9c08-7a51d7f7cb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0d613f-82ba-4c43-9c08-7a51d7f7cb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d5e686-8d96-43e8-ab92-26d4576bf1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d5e686-8d96-43e8-ab92-26d4576bf1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd314e3a-bdf0-4516-ba8e-da7bc9801efc', 'volume_name': 'volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9620c6-a53e-4442-8bb5-6f999c11fca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9620c6-a53e-4442-8bb5-6f999c11fca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:57:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c0a8071-3898-4e83-9e5c-0a01df4b9f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:57:54 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Volume fd314e3a-bdf0-4516-ba8e-da7bc9801efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc', 'volume_size': 1}
Apr 24 19:57:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:56 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-26fd1236-ca20-426a-bdcf-875b880f9850 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Terminate volume connection completed successfully.
Apr 24 19:57:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-26fd1236-ca20-426a-bdcf-875b880f9850 tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Deleting attachment 9fd00921-b6e9-490a-8326-490b87104479. {{(pid=81241) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 24 19:57:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Acquiring lock "cinder-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "cinder-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Acquiring lock "cinder-quobyte-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "cinder-quobyte-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc" acquired by "delete_volume" :: waited 0.053s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:57 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1749e90-8f80-4ac1-bf83-d233b61224e2]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:57 devstack sudo[86501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc
Apr 24 19:57:57 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:57 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1" returned: 0 in 6.097s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:57 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a86548-59cd-4355-8607-fa1c0d360f96]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:58 devstack sudo[86503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662
Apr 24 19:57:58 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:58 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc" returned: 0 in 0.777s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:58 devstack sudo[86508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc
Apr 24 19:57:58 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:58 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662" returned: 0 in 0.754s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:58 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1 {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 19:57:58 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Converted 1024.00 MB image at 167.91 MB/s
Apr 24 19:57:58 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1 is being set with open permissions: ugo+rw
Apr 24 19:57:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:58 devstack sudo[86514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1
Apr 24 19:57:58 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:58 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc" returned: 0 in 0.499s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "cinder-quobyte-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc" released by "delete_volume" :: held 1.354s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:58 devstack cinder-volume[81241]: DEBUG cinder.quota [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Created reservations ['86d5bfa1-aa25-451a-8dc1-c71a704b6684', 'c07f2f18-3ede-4311-b53b-9fc04056fefd', 'b5052369-4c42-46de-89e2-6f6d57bd3cd9', '05bac0fb-218d-42a0-a865-6e98281153f4'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:57:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:57:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:57:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:57:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:57:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:57:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:59 devstack sudo[86516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:57:59 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:59 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1" returned: 0 in 0.504s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1" released by "_copy_volume_from_snapshot" :: held 8.880s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-quobyte-57ed19e9-72f1-4a5f-9430-d24f8b383ae4" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-57ed19e9-72f1-4a5f-9430-d24f8b383ae4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Deleting offline snapshot 57ed19e9-72f1-4a5f-9430-d24f8b383ae4 of volume 4a596afd-d8c5-4284-b82b-84cd4e05c662 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] snapshot_file for this snap is: volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac6ab1b-7292-40c4-9ee8-d5823b170b2c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:57:59 devstack sudo[86520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4
Apr 24 19:57:59 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:57:59 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.568s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG cinder.manager [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:57:59 devstack cinder-volume[81241]: INFO cinder.volume.manager [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Deleted volume successfully.
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [req-3b3eb133-d1ca-4abb-930c-fb0c8312255a req-04e986b8-06ac-4c3b-98b7-c4636301038d tempest-ServerBootFromVolumeStableRescueTest-1929398584 None] Lock "cinder-2b8a5f02-cc9f-422e-b26b-84ea0260d7cc-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:57:59 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4" returned: 0 in 0.611s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a596afd-d8c5-4284-b82b-84cd4e05c662(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f71118b-4c42-4336-8307-52c6b617eae1]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:57:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:00 devstack sudo[86526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662
Apr 24 19:58:00 devstack sudo[86526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:00 devstack sudo[86526]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662" returned: 0 in 0.668s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:00 devstack sudo[86532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4
Apr 24 19:58:00 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:01 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4" returned: 0 in 0.586s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:01 devstack sudo[86546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4
Apr 24 19:58:01 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:01 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662.57ed19e9-72f1-4a5f-9430-d24f8b383ae4" returned: 0 in 0.752s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-57ed19e9-72f1-4a5f-9430-d24f8b383ae4" released by "_delete_snapshot" :: held 2.722s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.633s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.456s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-371650175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef340d5e-a11c-40e6-a384-682d4a8be58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5b3952a0974218a1283a74954a664b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:51Z,use_quota=True,user_id='f40e03d34f0a45de913283e4c652a13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Creating volume ef340d5e-a11c-40e6-a384-682d4a8be58b {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:58:02 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef340d5e-a11c-40e6-a384-682d4a8be58b 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:02 devstack sudo[86573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef340d5e-a11c-40e6-a384-682d4a8be58b 1073741824
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9fba8d8-66d4-43fe-9589-a56473c698b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1', 'volume_size': 1, 'source_volid': '4a596afd-d8c5-4284-b82b-84cd4e05c662', 'source_volstatus': 'available'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:02 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd852a1-0d00-49f9-8df5-86c0c9087bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:02 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Volume volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1 (3c2b39d6-a57f-4b43-8b04-af422fd3d1b1): created successfully
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd852a1-0d00-49f9-8df5-86c0c9087bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Flow 'volume_create_manager' (7ccbc45a-642e-4e1f-a5a8-4439d7bd365b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:02 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0afba1df-0ad6-4db5-bb85-5b2cf871ad5f tempest-VolumesGetTest-1780695330 None] Created volume successfully.
Apr 24 19:58:02 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef340d5e-a11c-40e6-a384-682d4a8be58b 1073741824" returned: 0 in 0.681s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef340d5e-a11c-40e6-a384-682d4a8be58b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:02 devstack sudo[86579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef340d5e-a11c-40e6-a384-682d4a8be58b
Apr 24 19:58:02 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Flow 'volume_create_manager' (bb0d9962-7c16-4d7d-9c9d-b8f6878ddca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709cc415-eabc-4d1b-9999-ce02ab2ddc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709cc415-eabc-4d1b-9999-ce02ab2ddc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2044576982',display_name='tempest-VolumesGetTest-Volume-107068456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa27077-63bd-4549-887f-2905ef39b384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31290650dc9249c2b80820cbbd52cae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:03Z,use_quota=True,user_id='d60db04009e6480489b51af31a4991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff1dab4-1f87-481a-b145-cde263c2d8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff1dab4-1f87-481a-b145-cde263c2d8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97df4c38-448a-48c3-a565-365ea8a5ef33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97df4c38-448a-48c3-a565-365ea8a5ef33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faa27077-63bd-4549-887f-2905ef39b384', 'volume_name': 'volume-faa27077-63bd-4549-887f-2905ef39b384', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31866100-6cfb-4dbc-aef2-7b4322321c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31866100-6cfb-4dbc-aef2-7b4322321c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad74a68-48b4-4c2c-b96f-7610e5dbeb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:03 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Volume faa27077-63bd-4549-887f-2905ef39b384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faa27077-63bd-4549-887f-2905ef39b384', 'volume_size': 1}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:03 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef340d5e-a11c-40e6-a384-682d4a8be58b" returned: 0 in 0.571s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.433s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-440707232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd314e3a-bdf0-4516-ba8e-da7bc9801efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7aecbffac9b4862bbab9a4057f2c050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:55Z,use_quota=True,user_id='79db5b50b8c44bab9060a64406bb8fab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Creating volume fd314e3a-bdf0-4516-ba8e-da7bc9801efc {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:58:03 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c33029-228a-4ec0-b5f3-703478c5f2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef340d5e-a11c-40e6-a384-682d4a8be58b', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:03 devstack sudo[86582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc 1073741824
Apr 24 19:58:03 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73d8965-aaed-450b-9fb3-65cd4950c90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:03 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Volume volume-ef340d5e-a11c-40e6-a384-682d4a8be58b (ef340d5e-a11c-40e6-a384-682d4a8be58b): created successfully
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73d8965-aaed-450b-9fb3-65cd4950c90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Flow 'volume_create_manager' (569ce905-9098-42be-8630-972c1aebbb92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:03 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-7f2f490a-47c8-4826-a57e-a7b34d9028e4 tempest-VolumesTransfersV357Test-1352225935 None] Created volume successfully.
Apr 24 19:58:04 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc 1073741824" returned: 0 in 0.676s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:04 devstack sudo[86588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc
Apr 24 19:58:04 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Acquiring lock "cinder-ef340d5e-a11c-40e6-a384-682d4a8be58b-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Lock "cinder-ef340d5e-a11c-40e6-a384-682d4a8be58b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Acquiring lock "cinder-quobyte-ef340d5e-a11c-40e6-a384-682d4a8be58b" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Lock "cinder-quobyte-ef340d5e-a11c-40e6-a384-682d4a8be58b" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a68b1c-fd32-4950-a904-366d9d162fd8]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef340d5e-a11c-40e6-a384-682d4a8be58b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:04 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc" returned: 0 in 0.612s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.441s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2044576982',display_name='tempest-VolumesGetTest-Volume-107068456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa27077-63bd-4549-887f-2905ef39b384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31290650dc9249c2b80820cbbd52cae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:03Z,use_quota=True,user_id='d60db04009e6480489b51af31a4991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Creating volume faa27077-63bd-4549-887f-2905ef39b384 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:58:04 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-faa27077-63bd-4549-887f-2905ef39b384 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:04 devstack sudo[86592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-faa27077-63bd-4549-887f-2905ef39b384 1073741824
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c0a8071-3898-4e83-9e5c-0a01df4b9f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:04 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e13e85-71d3-475c-8b5f-1dabb15f4c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:04 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Volume volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc (fd314e3a-bdf0-4516-ba8e-da7bc9801efc): created successfully
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e13e85-71d3-475c-8b5f-1dabb15f4c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Flow 'volume_create_manager' (bf121a9e-045a-493e-82b2-394ee510048e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:04 devstack sudo[86591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef340d5e-a11c-40e6-a384-682d4a8be58b
Apr 24 19:58:04 devstack sudo[86591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:04 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f8ecc8aa-5c67-4b49-ab3e-8adb6cef9ae9 tempest-AbsoluteLimitsTests-1962888525 None] Created volume successfully.
Apr 24 19:58:05 devstack sudo[86591]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef340d5e-a11c-40e6-a384-682d4a8be58b" returned: 0 in 0.598s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef340d5e-a11c-40e6-a384-682d4a8be58b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:05 devstack sudo[86601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef340d5e-a11c-40e6-a384-682d4a8be58b
Apr 24 19:58:05 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:05 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-faa27077-63bd-4549-887f-2905ef39b384 1073741824" returned: 0 in 0.715s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-faa27077-63bd-4549-887f-2905ef39b384 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:05 devstack sudo[86603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-faa27077-63bd-4549-887f-2905ef39b384
Apr 24 19:58:05 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:05 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ef340d5e-a11c-40e6-a384-682d4a8be58b" returned: 0 in 0.538s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Lock "cinder-quobyte-ef340d5e-a11c-40e6-a384-682d4a8be58b" released by "delete_volume" :: held 1.198s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:05 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Created reservations ['44d0378f-4250-4e19-8592-43ef94973493', '61fec840-8f12-45a7-b2f3-2197dac2f96d', 'a4193096-3077-4ad2-b3e3-b5c3b21900a3', '0d5dce60-9061-4b1b-bfd5-1abdbae70251'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:58:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Acquiring lock "cinder-fd314e3a-bdf0-4516-ba8e-da7bc9801efc-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Lock "cinder-fd314e3a-bdf0-4516-ba8e-da7bc9801efc-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Acquiring lock "cinder-quobyte-fd314e3a-bdf0-4516-ba8e-da7bc9801efc" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Lock "cinder-quobyte-fd314e3a-bdf0-4516-ba8e-da7bc9801efc" acquired by "delete_volume" :: waited 0.040s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:06 devstack sudo[86607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:58:06 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3488dacf-d337-4306-8a34-d5569fabc366]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:06 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-faa27077-63bd-4549-887f-2905ef39b384" returned: 0 in 0.648s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad74a68-48b4-4c2c-b96f-7610e5dbeb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa27077-63bd-4549-887f-2905ef39b384', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c742ca-cceb-4cb9-a6d8-b46e0391696d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:06 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Volume volume-faa27077-63bd-4549-887f-2905ef39b384 (faa27077-63bd-4549-887f-2905ef39b384): created successfully
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c742ca-cceb-4cb9-a6d8-b46e0391696d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Flow 'volume_create_manager' (bb0d9962-7c16-4d7d-9c9d-b8f6878ddca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:06 devstack sudo[86609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc
Apr 24 19:58:06 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:06 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-4dc7bd23-1cda-4a3c-a9c0-27c4ad78e3cc tempest-VolumesGetTest-1780695330 None] Created volume successfully.
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-faa27077-63bd-4549-887f-2905ef39b384-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Lock "cinder-faa27077-63bd-4549-887f-2905ef39b384-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-quobyte-faa27077-63bd-4549-887f-2905ef39b384" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-faa27077-63bd-4549-887f-2905ef39b384" acquired by "delete_volume" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[de17b85a-8fb3-45bb-ae39-0ac78b543042]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-faa27077-63bd-4549-887f-2905ef39b384 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:06 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.609s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:58:06 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Deleted volume successfully.
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-411299be-bb6e-49c8-9150-cfa41949676d tempest-VolumesTransfersV357Test-962956248 None] Lock "cinder-ef340d5e-a11c-40e6-a384-682d4a8be58b-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:06 devstack sudo[86615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-faa27077-63bd-4549-887f-2905ef39b384
Apr 24 19:58:06 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:06 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc" returned: 0 in 0.670s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:06 devstack sudo[86617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc
Apr 24 19:58:06 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:07 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:07 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-faa27077-63bd-4549-887f-2905ef39b384" returned: 0 in 0.702s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-faa27077-63bd-4549-887f-2905ef39b384 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fd314e3a-bdf0-4516-ba8e-da7bc9801efc" returned: 0 in 0.553s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:07 devstack sudo[86623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-faa27077-63bd-4549-887f-2905ef39b384
Apr 24 19:58:07 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Lock "cinder-quobyte-fd314e3a-bdf0-4516-ba8e-da7bc9801efc" released by "delete_volume" :: held 1.274s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Created reservations ['980b93dc-f326-4352-aa3d-31e079d5e41b', '4420c02b-16e1-417d-a1aa-6bf188b726c3', 'e7d6b6df-7bc4-4661-b15c-5e9f32f76fe8', 'd842fdec-b507-4eb1-a173-3315e5b04e46'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:07 devstack sudo[86626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:58:07 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:07 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-faa27077-63bd-4549-887f-2905ef39b384" returned: 0 in 0.585s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-faa27077-63bd-4549-887f-2905ef39b384" released by "delete_volume" :: held 1.337s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Created reservations ['a7466947-3fdb-47ed-b06f-25fd5c362763', '12b7209f-3bd4-4964-ace1-9628de96f78f', '11d59ef9-0a99-40b6-a1eb-9436285b7ba8', '4140082b-4388-4437-b9d7-b594b6c8ea2a'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:58:07 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.527s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:07 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:58:08 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Deleted volume successfully.
Apr 24 19:58:08 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0a97401a-6fc6-4b8c-adfe-3eea2601d1d2 tempest-AbsoluteLimitsTests-1962888525 None] Lock "cinder-fd314e3a-bdf0-4516-ba8e-da7bc9801efc-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:08 devstack sudo[86631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:58:08 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:08 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:08 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Lock "cinder-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:08 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.914s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:08 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:58:09 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Deleted volume successfully.
Apr 24 19:58:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-quobyte-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1" acquired by "delete_volume" :: waited 0.035s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:09 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ec45eb-4af1-4130-80b9-c8402128ec4b]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7421d1a8-aa5d-48dd-85a6-27122b43fb9b tempest-VolumesGetTest-1780695330 None] Lock "cinder-faa27077-63bd-4549-887f-2905ef39b384-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:09 devstack sudo[86635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1
Apr 24 19:58:09 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:09 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1" returned: 0 in 0.697s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:09 devstack sudo[86640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1
Apr 24 19:58:09 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:10 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1" returned: 0 in 0.608s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1" released by "delete_volume" :: held 1.393s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:10 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Created reservations ['473711d3-fcfc-4bf3-b0fd-8e4ac7d744cf', 'c1e53be9-ba59-453c-ba6f-71e831725441', '98ddc365-9b1e-4a1b-954c-1d1120a4b992', '6dfca5b6-e011-4de7-a8c2-56704003e489'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:58:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:10 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:10 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:10 devstack sudo[86644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:58:10 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:11 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.616s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:11 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:58:11 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Deleted volume successfully.
Apr 24 19:58:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-75c8586e-ca1c-4aa4-964e-d3ac6b59b65f tempest-VolumesGetTest-1780695330 None] Lock "cinder-3c2b39d6-a57f-4b43-8b04-af422fd3d1b1-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-4a596afd-d8c5-4284-b82b-84cd4e05c662-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Lock "cinder-4a596afd-d8c5-4284-b82b-84cd4e05c662-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-quobyte-4a596afd-d8c5-4284-b82b-84cd4e05c662" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-4a596afd-d8c5-4284-b82b-84cd4e05c662" acquired by "delete_volume" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:11 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92ffbd9-b28e-42fc-a681-d2d49bf7e75c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:11 devstack sudo[86647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662
Apr 24 19:58:11 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:12 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662" returned: 0 in 0.791s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:12 devstack sudo[86652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662
Apr 24 19:58:12 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:12 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4a596afd-d8c5-4284-b82b-84cd4e05c662" returned: 0 in 0.768s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:13 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-4a596afd-d8c5-4284-b82b-84cd4e05c662" released by "delete_volume" :: held 1.633s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:13 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Created reservations ['2ddfa771-4138-4133-a9b5-fb3ce850b6ba', '62b5c0b3-5905-4ec6-b5ed-de4b6740c811', '7f449f81-2d33-4b93-b3de-e7ca11b7b432', 'b45aaee2-efd0-4e5a-87cf-084df33f13db'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:58:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:13 devstack sudo[86656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:58:13 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:13 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.754s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:13 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:58:14 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Deleted volume successfully.
Apr 24 19:58:14 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89fbccd6-4592-41d7-ad1e-3d854c1bd1b9 tempest-VolumesGetTest-1780695330 None] Lock "cinder-4a596afd-d8c5-4284-b82b-84cd4e05c662-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:14 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:58:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Flow 'volume_create_manager' (f9636d48-ce16-4f20-822a-8fa9f0c1f6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1492f29d-1a27-485d-9074-217127117bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1492f29d-1a27-485d-9074-217127117bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-306512614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359401f2-28bc-4f77-9086-19a8b49d9b0f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='31290650dc9249c2b80820cbbd52cae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:14Z,use_quota=True,user_id='d60db04009e6480489b51af31a4991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c42517-be28-4a5c-b507-6d43e355422f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c42517-be28-4a5c-b507-6d43e355422f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c2dc6c-1641-4147-a5e8-fe832c0979b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:14 devstack cinder-volume[81241]: DEBUG cinder.image.glance [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Creating Keystone auth plugin from conf {{(pid=81241) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 24 19:58:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c2dc6c-1641-4147-a5e8-fe832c0979b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '359401f2-28bc-4f77-9086-19a8b49d9b0f', 'volume_name': 'volume-359401f2-28bc-4f77-9086-19a8b49d9b0f', 'volume_size': 1, 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b862a13976c94661b0ca990e233a527c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'created_at': datetime.datetime(2026, 4, 24, 17, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 48, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f02e7c9ab90>}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b29f92-541c-4ec7-82d9-0c18d79789a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b29f92-541c-4ec7-82d9-0c18d79789a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b55040c-27b5-4e7d-a742-b3ade1078227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:14 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Volume 359401f2-28bc-4f77-9086-19a8b49d9b0f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-359401f2-28bc-4f77-9086-19a8b49d9b0f', 'volume_size': 1, 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b862a13976c94661b0ca990e233a527c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'created_at': datetime.datetime(2026, 4, 24, 17, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 48, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f02e7c9ab90>}
Apr 24 19:58:14 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Trying to clone 359401f2-28bc-4f77-9086-19a8b49d9b0f from image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]). {{(pid=81241) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Flow 'volume_create_manager' (e5c092c9-1e5f-4d21-af80-64be1e27ddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5999690-89ef-45d2-8de3-c94b1c4ef3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5999690-89ef-45d2-8de3-c94b1c4ef3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1850548118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db17e173-3760-49c0-951c-e580197caa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468a711219ff4a88b0080b4398b622ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:15Z,use_quota=True,user_id='151ab0b873924731b1dcfe6dd54c0c90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2af780-111c-4061-bf0e-e812ca825c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2af780-111c-4061-bf0e-e812ca825c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b31d341-4526-4bc4-a636-0dcf670b4fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b31d341-4526-4bc4-a636-0dcf670b4fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db17e173-3760-49c0-951c-e580197caa63', 'volume_name': 'volume-db17e173-3760-49c0-951c-e580197caa63', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8060a62-761a-4514-a469-69ab709f0a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8060a62-761a-4514-a469-69ab709f0a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04db824e-d4f8-4edc-9daf-87b79f1ce148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:15 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Volume db17e173-3760-49c0-951c-e580197caa63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db17e173-3760-49c0-951c-e580197caa63', 'volume_size': 1}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1850548118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db17e173-3760-49c0-951c-e580197caa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468a711219ff4a88b0080b4398b622ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:15Z,use_quota=True,user_id='151ab0b873924731b1dcfe6dd54c0c90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Creating volume db17e173-3760-49c0-951c-e580197caa63 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:58:15 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db17e173-3760-49c0-951c-e580197caa63 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:15 devstack sudo[86660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db17e173-3760-49c0-951c-e580197caa63 1073741824
Apr 24 19:58:15 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_so_14e_ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81241) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 24 19:58:15 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Image download 20.69 MB at 20.69 MB/s
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa10736-9874-4732-b438-8914c184f009]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_so_14e_ydevstack@QuobyteHD {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:15 devstack sudo[86662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_so_14e_ydevstack@QuobyteHD
Apr 24 19:58:15 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:16 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db17e173-3760-49c0-951c-e580197caa63 1073741824" returned: 0 in 0.865s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db17e173-3760-49c0-951c-e580197caa63 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:16 devstack sudo[86670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db17e173-3760-49c0-951c-e580197caa63
Apr 24 19:58:16 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:16 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_so_14e_ydevstack@QuobyteHD" returned: 0 in 0.898s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:16 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Temporary image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd is fetched for user d60db04009e6480489b51af31a4991d7. {{(pid=81241) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 24 19:58:16 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[52782c91-0645-45a1-91ee-64eee61d57a4]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_so_14e_ydevstack@QuobyteHD {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:16 devstack sudo[86672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_so_14e_ydevstack@QuobyteHD
Apr 24 19:58:16 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:16 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db17e173-3760-49c0-951c-e580197caa63" returned: 0 in 0.630s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:58:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04db824e-d4f8-4edc-9daf-87b79f1ce148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db17e173-3760-49c0-951c-e580197caa63', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feaf042f-d280-4a5c-b3e5-c6cbfcc258d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:16 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Volume volume-db17e173-3760-49c0-951c-e580197caa63 (db17e173-3760-49c0-951c-e580197caa63): created successfully
Apr 24 19:58:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feaf042f-d280-4a5c-b3e5-c6cbfcc258d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Flow 'volume_create_manager' (e5c092c9-1e5f-4d21-af80-64be1e27ddc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:16 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-319687c8-4835-4343-a37c-40ed09d8ef69 tempest-VolumesMetadataTest-1639480449 None] Created volume successfully.
Apr 24 19:58:17 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_so_14e_ydevstack@QuobyteHD" returned: 0 in 0.923s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:17 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-306512614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359401f2-28bc-4f77-9086-19a8b49d9b0f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='31290650dc9249c2b80820cbbd52cae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:14Z,use_quota=True,user_id='d60db04009e6480489b51af31a4991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:58:17 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Creating volume 359401f2-28bc-4f77-9086-19a8b49d9b0f {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:58:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:17 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:17 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:17 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:58:17 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:58:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:17 devstack sudo[86678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f 1073741824
Apr 24 19:58:17 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:18 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f 1073741824" returned: 0 in 0.856s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:18 devstack sudo[86683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f
Apr 24 19:58:18 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Acquiring lock "cinder-db17e173-3760-49c0-951c-e580197caa63-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Lock "cinder-db17e173-3760-49c0-951c-e580197caa63-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Acquiring lock "cinder-quobyte-db17e173-3760-49c0-951c-e580197caa63" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Lock "cinder-quobyte-db17e173-3760-49c0-951c-e580197caa63" acquired by "delete_volume" :: waited 0.032s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:18 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[127f50f7-15cb-4ffe-857c-3b66caaef2a3]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db17e173-3760-49c0-951c-e580197caa63 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:18 devstack sudo[86685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db17e173-3760-49c0-951c-e580197caa63
Apr 24 19:58:18 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:18 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f" returned: 0 in 0.679s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:18 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:58:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:19 devstack cinder-volume[81241]: DEBUG cinder.volume.volume_utils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Attempting download of 8c41cab8-e7de-4393-aaaf-cc39ab149fdd ((None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}])) to volume 359401f2-28bc-4f77-9086-19a8b49d9b0f. {{(pid=81241) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 24 19:58:19 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bd6afd-9c3e-40f9-b059-05a9f6a75f12]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_6rqkd01t {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:19 devstack sudo[86695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_6rqkd01t
Apr 24 19:58:19 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:19 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db17e173-3760-49c0-951c-e580197caa63" returned: 0 in 0.783s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db17e173-3760-49c0-951c-e580197caa63 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:19 devstack sudo[86700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db17e173-3760-49c0-951c-e580197caa63
Apr 24 19:58:19 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:19 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_6rqkd01t" returned: 0 in 0.783s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_6rqkd01t {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:19 devstack sudo[86704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_6rqkd01t
Apr 24 19:58:19 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:20 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db17e173-3760-49c0-951c-e580197caa63" returned: 0 in 0.622s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Lock "cinder-quobyte-db17e173-3760-49c0-951c-e580197caa63" released by "delete_volume" :: held 1.455s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Created reservations ['cbbdd718-eee0-4ca6-9586-daf95c06cbd1', '1c8c471e-80a2-477f-a765-c427b944dd34', 'ebf3a030-a86d-4477-9279-96dcf3d30044', '16d1df10-a950-4b05-ae8e-195a5e38b878'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:20 devstack sudo[86707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:58:20 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:20 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_6rqkd01t" returned: 1 in 0.674s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_6rqkd01t' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0969a514-366e-4b2e-a0ea-d00e5a98ed39]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_so_14e_ydevstack@QuobyteHD {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:20 devstack sudo[86711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_so_14e_ydevstack@QuobyteHD
Apr 24 19:58:20 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:20 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.727s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:58:20 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Deleted volume successfully.
Apr 24 19:58:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-02574cf6-0567-4a98-a9fd-05419691ba44 tempest-VolumesMetadataTest-1639480449 None] Lock "cinder-db17e173-3760-49c0-951c-e580197caa63-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:21 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_so_14e_ydevstack@QuobyteHD" returned: 0 in 0.877s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:21 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] 8c41cab8-e7de-4393-aaaf-cc39ab149fdd was qcow2, converting to raw {{(pid=81241) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 24 19:58:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_so_14e_ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:21 devstack sudo[86717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_so_14e_ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f
Apr 24 19:58:21 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:23 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_so_14e_ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f" returned: 0 in 1.694s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:23 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_so_14e_ydevstack@QuobyteHD, size 112.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 19:58:23 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Converted 112.00 MB image at 66.01 MB/s
Apr 24 19:58:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:23 devstack sudo[86730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f 1G
Apr 24 19:58:23 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:23 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f 1G" returned: 0 in 0.584s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:23 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f866650-3835-4575-b48c-4cf4d61d9be4]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:23 devstack sudo[86735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f
Apr 24 19:58:23 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 19:58:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:24 devstack sudo[86737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:58:24 devstack sudo[86737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:24 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f" returned: 0 in 0.840s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:24 devstack sudo[86737]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.781s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:24 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:58:24 devstack sudo[86741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f
Apr 24 19:58:24 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:25 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f" returned: 1 in 0.882s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 19:58:25 devstack cinder-volume[81241]: DEBUG cinder.volume.volume_utils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Downloaded image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd ((None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}])) to volume 359401f2-28bc-4f77-9086-19a8b49d9b0f successfully. {{(pid=81241) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 24 19:58:25 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Temporary image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd for user d60db04009e6480489b51af31a4991d7 is deleted. {{(pid=81241) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 24 19:58:25 devstack cinder-volume[81241]: DEBUG cinder.volume.volume_utils [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Marking volume 359401f2-28bc-4f77-9086-19a8b49d9b0f as bootable. {{(pid=81241) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 24 19:58:25 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Copying metadata from image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd to 359401f2-28bc-4f77-9086-19a8b49d9b0f. {{(pid=81241) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 24 19:58:25 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Creating volume glance metadata for volume 359401f2-28bc-4f77-9086-19a8b49d9b0f backed by image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81241) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 24 19:58:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b55040c-27b5-4e7d-a742-b3ade1078227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-359401f2-28bc-4f77-9086-19a8b49d9b0f', 'volume_size': 1, 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b862a13976c94661b0ca990e233a527c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'created_at': datetime.datetime(2026, 4, 24, 17, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 48, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f02e7c9ab90>}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323eaf3c-1ad0-421f-b4de-a1931369d99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:25 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Volume volume-359401f2-28bc-4f77-9086-19a8b49d9b0f (359401f2-28bc-4f77-9086-19a8b49d9b0f): created successfully
Apr 24 19:58:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323eaf3c-1ad0-421f-b4de-a1931369d99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Flow 'volume_create_manager' (f9636d48-ce16-4f20-822a-8fa9f0c1f6aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:25 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0ddad08a-4018-435a-98b2-8a984d7474bc tempest-VolumesGetTest-1780695330 None] Created volume successfully.
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Flow 'volume_create_manager' (bf4e55ee-e43b-4a36-b44f-515001a4e968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbcc072-e5cb-4f0d-b7ba-2688b7c7c504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbcc072-e5cb-4f0d-b7ba-2688b7c7c504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1752200882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5881155c-1b92-4703-9f57-05fd8f9e7390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7ee2771ce74eacbbc70f48ca332e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:26Z,use_quota=True,user_id='60560290542946e98e3f86f48609477b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825e6b79-510f-46f0-870e-539900ba7aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825e6b79-510f-46f0-870e-539900ba7aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adf2965-614b-4cf0-b579-0fa080522424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adf2965-614b-4cf0-b579-0fa080522424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5881155c-1b92-4703-9f57-05fd8f9e7390', 'volume_name': 'volume-5881155c-1b92-4703-9f57-05fd8f9e7390', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b202f36d-b175-4651-a672-653a3bcf7b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b202f36d-b175-4651-a672-653a3bcf7b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ea6aa2-9285-40ba-b175-60043478c9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:26 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Volume 5881155c-1b92-4703-9f57-05fd8f9e7390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5881155c-1b92-4703-9f57-05fd8f9e7390', 'volume_size': 1}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1752200882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5881155c-1b92-4703-9f57-05fd8f9e7390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7ee2771ce74eacbbc70f48ca332e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:26Z,use_quota=True,user_id='60560290542946e98e3f86f48609477b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Creating volume 5881155c-1b92-4703-9f57-05fd8f9e7390 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:58:26 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:58:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:26 devstack sudo[86747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390 1073741824
Apr 24 19:58:26 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:27 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:58:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Flow 'volume_create_manager' (e91a41c6-8f05-4211-a763-68f361cc091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1646598e-7464-4b8f-b1aa-cca6847d5ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1646598e-7464-4b8f-b1aa-cca6847d5ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1658744721',display_name='tempest-VolumesGetTest-Volume-1723212130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bc6519-e864-496b-8602-e8d640829691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31290650dc9249c2b80820cbbd52cae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:27Z,use_quota=True,user_id='d60db04009e6480489b51af31a4991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5676b3ea-2ac5-4fb0-a60d-0256b062f733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5676b3ea-2ac5-4fb0-a60d-0256b062f733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582b841a-8db7-433d-b2ba-c0760739be5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582b841a-8db7-433d-b2ba-c0760739be5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7bc6519-e864-496b-8602-e8d640829691', 'volume_name': 'volume-b7bc6519-e864-496b-8602-e8d640829691', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180f0280-42c7-4bbc-8ae7-ea22f029e8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180f0280-42c7-4bbc-8ae7-ea22f029e8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d6b2e1-9d56-48b3-b8c7-a38406bf86da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:27 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Volume b7bc6519-e864-496b-8602-e8d640829691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7bc6519-e864-496b-8602-e8d640829691', 'volume_size': 1}
Apr 24 19:58:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:27 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390 1073741824" returned: 0 in 0.995s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:27 devstack sudo[86753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390
Apr 24 19:58:27 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:28 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390" returned: 0 in 0.548s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1658744721',display_name='tempest-VolumesGetTest-Volume-1723212130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bc6519-e864-496b-8602-e8d640829691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31290650dc9249c2b80820cbbd52cae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:27Z,use_quota=True,user_id='d60db04009e6480489b51af31a4991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Creating volume b7bc6519-e864-496b-8602-e8d640829691 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:58:28 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7bc6519-e864-496b-8602-e8d640829691 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ea6aa2-9285-40ba-b175-60043478c9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5881155c-1b92-4703-9f57-05fd8f9e7390', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:28 devstack sudo[86756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7bc6519-e864-496b-8602-e8d640829691 1073741824
Apr 24 19:58:28 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ff3469-ca89-4733-b65c-2a9a03c16278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:28 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Volume volume-5881155c-1b92-4703-9f57-05fd8f9e7390 (5881155c-1b92-4703-9f57-05fd8f9e7390): created successfully
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ff3469-ca89-4733-b65c-2a9a03c16278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Flow 'volume_create_manager' (bf4e55ee-e43b-4a36-b44f-515001a4e968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:28 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b7b80647-37a2-4db0-9313-33a4a177147c tempest-VolumesCloneTest-1190974476 None] Created volume successfully.
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Flow 'volume_create_manager' (4f547d7e-78f4-4367-b8d5-1e478e55d63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5a290e-bcb1-4d63-ade9-18bbea577f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5a290e-bcb1-4d63-ade9-18bbea577f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1930716248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0677b5-10dd-40c4-b569-29324ac76762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7ee2771ce74eacbbc70f48ca332e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=5881155c-1b92-4703-9f57-05fd8f9e7390,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:29Z,use_quota=True,user_id='60560290542946e98e3f86f48609477b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b07b981-a237-433d-adb6-8a0e2b48771d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:28 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b07b981-a237-433d-adb6-8a0e2b48771d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427d0bc8-3c10-4818-95ac-3fd370ebf2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7bc6519-e864-496b-8602-e8d640829691 1073741824" returned: 0 in 0.919s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427d0bc8-3c10-4818-95ac-3fd370ebf2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2c0677b5-10dd-40c4-b569-29324ac76762', 'volume_name': 'volume-2c0677b5-10dd-40c4-b569-29324ac76762', 'volume_size': 2, 'source_volid': '5881155c-1b92-4703-9f57-05fd8f9e7390', 'source_volstatus': 'available'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a25965-4b76-45e2-9fbe-e6ec1620df6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a25965-4b76-45e2-9fbe-e6ec1620df6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5a6349-7ab6-4766-8dd3-26fe06bd2762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:29 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Volume 2c0677b5-10dd-40c4-b569-29324ac76762: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2c0677b5-10dd-40c4-b569-29324ac76762', 'volume_size': 2, 'source_volid': '5881155c-1b92-4703-9f57-05fd8f9e7390', 'source_volstatus': 'available'}
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7bc6519-e864-496b-8602-e8d640829691 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:29 devstack sudo[86761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7bc6519-e864-496b-8602-e8d640829691
Apr 24 19:58:29 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:29 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7bc6519-e864-496b-8602-e8d640829691" returned: 0 in 0.661s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.681s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:29 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Cloning volume 5881155c-1b92-4703-9f57-05fd8f9e7390 to volume 2c0677b5-10dd-40c4-b569-29324ac76762
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d6b2e1-9d56-48b3-b8c7-a38406bf86da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7bc6519-e864-496b-8602-e8d640829691', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203daa3b-3e63-47e6-918c-b621faa7879e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Creating offline snapshot 8f373c56-20ae-420e-9597-c226e9192d41 of volume 5881155c-1b92-4703-9f57-05fd8f9e7390 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 19:58:29 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Volume volume-b7bc6519-e864-496b-8602-e8d640829691 (b7bc6519-e864-496b-8602-e8d640829691): created successfully
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203daa3b-3e63-47e6-918c-b621faa7879e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Flow 'volume_create_manager' (e91a41c6-8f05-4211-a763-68f361cc091d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3e2af0-6169-46e9-b736-3dd0ef1371d0]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:29 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f3eee272-2581-4096-9fe2-236cbba7004b tempest-VolumesGetTest-1780695330 None] Created volume successfully.
Apr 24 19:58:29 devstack sudo[86765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390
Apr 24 19:58:29 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-b7bc6519-e864-496b-8602-e8d640829691-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Lock "cinder-b7bc6519-e864-496b-8602-e8d640829691-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:30 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-quobyte-b7bc6519-e864-496b-8602-e8d640829691" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390" returned: 0 in 0.862s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-b7bc6519-e864-496b-8602-e8d640829691" acquired by "delete_volume" :: waited 0.034s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:30 devstack sudo[86770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41 1G
Apr 24 19:58:30 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:30 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ab35f6-9fab-48c7-ad85-2e89d150c953]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7bc6519-e864-496b-8602-e8d640829691 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:30 devstack sudo[86772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7bc6519-e864-496b-8602-e8d640829691
Apr 24 19:58:30 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Flow 'volume_create_manager' (a69dc127-a7c8-4ed1-8edc-5a53a6578034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f45a6c-971c-4c96-87dd-f18027bfff0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f45a6c-971c-4c96-87dd-f18027bfff0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-268383391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c70d4660d384708841b82377134cbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:31Z,use_quota=True,user_id='3ebcebd5c01f40caa651f73b0ba6572e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9fb1e05-e8f1-4a54-8e48-8fe4c7a033ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9fb1e05-e8f1-4a54-8e48-8fe4c7a033ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb7dea7-e9ee-48bd-84cd-51d7c7df0452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb7dea7-e9ee-48bd-84cd-51d7c7df0452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b', 'volume_name': 'volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f47a567-3e84-4ada-9e6e-4caaa069f3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f47a567-3e84-4ada-9e6e-4caaa069f3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2a3501-63a1-45b8-b614-635d5bdcbcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:31 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Volume cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b', 'volume_size': 1}
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:31 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7bc6519-e864-496b-8602-e8d640829691" returned: 0 in 0.766s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7bc6519-e864-496b-8602-e8d640829691 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:31 devstack sudo[86780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7bc6519-e864-496b-8602-e8d640829691
Apr 24 19:58:31 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:31 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41 1G" returned: 0 in 0.850s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5881155c-1b92-4703-9f57-05fd8f9e7390 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:31 devstack sudo[86782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5881155c-1b92-4703-9f57-05fd8f9e7390 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41
Apr 24 19:58:31 devstack sudo[86782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:32 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7bc6519-e864-496b-8602-e8d640829691" returned: 0 in 0.570s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:32 devstack sudo[86782]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-b7bc6519-e864-496b-8602-e8d640829691" released by "delete_volume" :: held 1.412s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5881155c-1b92-4703-9f57-05fd8f9e7390 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41" returned: 0 in 0.591s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:32 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41 is being set with open permissions: ugo+rw
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:32 devstack sudo[86792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41
Apr 24 19:58:32 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Created reservations ['51585f75-e693-47cb-bd28-74e227969072', 'e5fbaae2-86b7-431d-b035-7b5380b11c81', '60b4d0a5-62a2-4c53-ac42-fc59014219ae', 'ca2479a3-acd6-44c5-81df-edc7335429f3'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:32 devstack sudo[86794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:58:32 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:32 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41" returned: 0 in 0.485s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:32 devstack sudo[86797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.info
Apr 24 19:58:32 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:32 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.521s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:58:32 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Deleted volume successfully.
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d79f5e7d-4adc-4fc6-aa42-bcce2bd815c9 tempest-VolumesGetTest-1780695330 None] Lock "cinder-b7bc6519-e864-496b-8602-e8d640829691-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-359401f2-28bc-4f77-9086-19a8b49d9b0f-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Lock "cinder-359401f2-28bc-4f77-9086-19a8b49d9b0f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Acquiring lock "cinder-quobyte-359401f2-28bc-4f77-9086-19a8b49d9b0f" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-359401f2-28bc-4f77-9086-19a8b49d9b0f" acquired by "delete_volume" :: waited 0.033s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7cdffa-5442-45f0-bd7c-b0a946e35a72]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:33 devstack sudo[86801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f
Apr 24 19:58:33 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:33 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.info" returned: 0 in 0.633s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:33 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.info is being set with open permissions: ugo+rw
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:33 devstack sudo[86804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.info
Apr 24 19:58:33 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:33 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f" returned: 0 in 0.542s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:33 devstack sudo[86809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f
Apr 24 19:58:33 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:33 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.info" returned: 0 in 0.475s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Acquiring lock "cinder-quobyte-2c0677b5-10dd-40c4-b569-29324ac76762" by "_copy_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Lock "cinder-quobyte-2c0677b5-10dd-40c4-b569-29324ac76762" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] snapshot: 8f373c56-20ae-420e-9597-c226e9192d41, volume: 2c0677b5-10dd-40c4-b569-29324ac76762,  {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a0026a-d244-448f-b580-d5d07899803d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:33 devstack sudo[86811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41
Apr 24 19:58:33 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:34 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f" returned: 1 in 0.700s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 19:58:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:34 devstack sudo[86819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f
Apr 24 19:58:34 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:34 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41" returned: 0 in 0.641s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5881155c-1b92-4703-9f57-05fd8f9e7390(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:58:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390 {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 19:58:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Creating direct copy from snapshot {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 19:58:34 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9740611-4d66-4fd4-8ca4-cb8b054cf2e0]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:34 devstack sudo[86821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390
Apr 24 19:58:34 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:34 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-359401f2-28bc-4f77-9086-19a8b49d9b0f" returned: 0 in 0.502s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:34 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Lock "cinder-quobyte-359401f2-28bc-4f77-9086-19a8b49d9b0f" released by "delete_volume" :: held 1.820s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:34 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Created reservations ['3dc4890e-b2ac-48d9-a9b6-b704deb268ad', 'aee8517f-db85-4f32-95be-35b0c8555e12', '10433559-606d-413c-af88-8844dae35399', '62b7aacf-be22-4107-8692-4180b739dfd6'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:58:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:35 devstack sudo[86827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:58:35 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:35 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390" returned: 0 in 0.616s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:35 devstack cinder-volume[81241]: DEBUG cinder.utils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Path /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762 not found in is_blk_device check {{(pid=81241) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 19:58:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:35 devstack sudo[86829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762
Apr 24 19:58:35 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:35 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.660s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:35 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:58:35 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Deleted volume successfully.
Apr 24 19:58:35 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-98407011-8c81-4c07-9bab-8a44d78681c0 tempest-VolumesGetTest-1780695330 None] Lock "cinder-359401f2-28bc-4f77-9086-19a8b49d9b0f-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:42 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762" returned: 0 in 7.067s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:42 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f6c32c-db46-428d-af84-4d7b5f0a48e5]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:42 devstack sudo[86892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390
Apr 24 19:58:42 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:43 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390" returned: 0 in 0.819s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:43 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390, size 1024.00 MB, duration 7.07 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762 {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 19:58:43 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Converted 1024.00 MB image at 144.88 MB/s
Apr 24 19:58:43 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762 is being set with open permissions: ugo+rw
Apr 24 19:58:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:43 devstack sudo[86898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762
Apr 24 19:58:43 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:43 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762" returned: 0 in 0.541s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Lock "cinder-quobyte-2c0677b5-10dd-40c4-b569-29324ac76762" released by "_copy_volume_from_snapshot" :: held 9.780s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:43 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=117,cinder:UPDATE=173,cinder:DELETE=12,cinder:INSERT=38 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:58:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Acquiring lock "cinder-quobyte-8f373c56-20ae-420e-9597-c226e9192d41" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Lock "cinder-quobyte-8f373c56-20ae-420e-9597-c226e9192d41" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Deleting offline snapshot 8f373c56-20ae-420e-9597-c226e9192d41 of volume 5881155c-1b92-4703-9f57-05fd8f9e7390 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 19:58:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] snapshot_file for this snap is: volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 19:58:43 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12e17b2-5d63-4e03-9652-a377ffc64cf5]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:43 devstack sudo[86901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41
Apr 24 19:58:43 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=120,cinder:INSERT=54,cinder:UPDATE=158,cinder:DELETE=15 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:58:44 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Flow 'volume_create_manager' (d2ac048d-3f8d-4c13-b82b-d8a358eb062f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5719e40-1d7f-4cec-bb22-290d3b5c14b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41" returned: 0 in 0.606s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5881155c-1b92-4703-9f57-05fd8f9e7390(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cc16d5-d91a-4d3b-8d84-1836abd88ae9]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5719e40-1d7f-4cec-bb22-290d3b5c14b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1783664854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa7ab613-e69b-4b9b-aea0-e0f11f71c89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b38275501141a1bea116ebf6e9a40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:44Z,use_quota=True,user_id='9f4515f660f449228f2284e69295d2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c167756a-587f-4d62-9e2a-a531c624506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c167756a-587f-4d62-9e2a-a531c624506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b4587e-8681-43dd-9d0e-c8a03fe78a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b4587e-8681-43dd-9d0e-c8a03fe78a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa7ab613-e69b-4b9b-aea0-e0f11f71c89d', 'volume_name': 'volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d2012c-0c13-44bc-846e-db9fcb9aefe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d2012c-0c13-44bc-846e-db9fcb9aefe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe5725f-dfb9-4f61-a212-feeef6aa2f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:44 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume aa7ab613-e69b-4b9b-aea0-e0f11f71c89d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d', 'volume_size': 1}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:44 devstack sudo[86906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390
Apr 24 19:58:44 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:44 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390" returned: 0 in 0.602s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:44 devstack sudo[86911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41
Apr 24 19:58:44 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:45 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41" returned: 0 in 0.612s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:45 devstack sudo[86916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41
Apr 24 19:58:45 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:45 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390.8f373c56-20ae-420e-9597-c226e9192d41" returned: 0 in 0.417s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Lock "cinder-quobyte-8f373c56-20ae-420e-9597-c226e9192d41" released by "_delete_snapshot" :: held 2.331s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.252s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.838s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-268383391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c70d4660d384708841b82377134cbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:31Z,use_quota=True,user_id='3ebcebd5c01f40caa651f73b0ba6572e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Creating volume cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:58:45 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:58:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:46 devstack sudo[86922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b 1073741824
Apr 24 19:58:46 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5a6349-7ab6-4766-8dd3-26fe06bd2762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c0677b5-10dd-40c4-b569-29324ac76762', 'volume_size': 2, 'source_volid': '5881155c-1b92-4703-9f57-05fd8f9e7390', 'source_volstatus': 'available'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4650b063-ba8f-43f7-b8ca-67382fc97d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:46 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Volume volume-2c0677b5-10dd-40c4-b569-29324ac76762 (2c0677b5-10dd-40c4-b569-29324ac76762): created successfully
Apr 24 19:58:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4650b063-ba8f-43f7-b8ca-67382fc97d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Flow 'volume_create_manager' (4f547d7e-78f4-4367-b8d5-1e478e55d63e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:46 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-61db6cb2-d00d-4491-bba4-6780bf723260 tempest-VolumesCloneTest-1190974476 None] Created volume successfully.
Apr 24 19:58:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Acquiring lock "cinder-2c0677b5-10dd-40c4-b569-29324ac76762-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:46 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b 1073741824" returned: 0 in 0.715s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Lock "cinder-2c0677b5-10dd-40c4-b569-29324ac76762-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Acquiring lock "cinder-quobyte-2c0677b5-10dd-40c4-b569-29324ac76762" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Lock "cinder-quobyte-2c0677b5-10dd-40c4-b569-29324ac76762" acquired by "delete_volume" :: waited 0.033s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:46 devstack sudo[86927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b
Apr 24 19:58:46 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:46 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5461a84c-5d8c-4b96-9d53-f5e82d764048]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:46 devstack sudo[86929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762
Apr 24 19:58:46 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:47 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" returned: 0 in 0.447s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.896s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1783664854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa7ab613-e69b-4b9b-aea0-e0f11f71c89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b38275501141a1bea116ebf6e9a40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:44Z,use_quota=True,user_id='9f4515f660f449228f2284e69295d2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Creating volume aa7ab613-e69b-4b9b-aea0-e0f11f71c89d {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:58:47 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2a3501-63a1-45b8-b614-635d5bdcbcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:47 devstack sudo[86934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d 1073741824
Apr 24 19:58:47 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf62b386-3f42-4fea-a9cc-5d32bf6e8877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:47 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Volume volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b (cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b): created successfully
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf62b386-3f42-4fea-a9cc-5d32bf6e8877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Flow 'volume_create_manager' (a69dc127-a7c8-4ed1-8edc-5a53a6578034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:47 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-4ad33408-0ad9-4e32-bce4-73281818cfa4 tempest-VolumesActionsTest-1357342770 None] Created volume successfully.
Apr 24 19:58:47 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762" returned: 0 in 0.569s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:47 devstack sudo[86940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762
Apr 24 19:58:47 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:47 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2c0677b5-10dd-40c4-b569-29324ac76762" returned: 0 in 0.538s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Lock "cinder-quobyte-2c0677b5-10dd-40c4-b569-29324ac76762" released by "delete_volume" :: held 1.165s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:47 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d 1073741824" returned: 0 in 0.747s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Created reservations ['cec82251-906a-41bd-af38-c1756494e3ae', '9413eb3b-f876-40d3-bd31-12c967989c08', '782b4d21-4e4d-4be6-82c1-43474a061b31', 'e7954624-3fa5-429c-b0b0-fb96251649e4'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:48 devstack sudo[86953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d
Apr 24 19:58:48 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:48 devstack sudo[86955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:58:48 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:48 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d" returned: 0 in 0.767s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe5725f-dfb9-4f61-a212-feeef6aa2f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138032c0-5be5-46d8-bf9d-410d1cbae3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:48 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d (aa7ab613-e69b-4b9b-aea0-e0f11f71c89d): created successfully
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138032c0-5be5-46d8-bf9d-410d1cbae3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Flow 'volume_create_manager' (d2ac048d-3f8d-4c13-b82b-d8a358eb062f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:48 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-fabbf460-53ae-43d0-acbd-72169842832f tempest-CreateVolumesFromSnapshotTest-953738396 None] Created volume successfully.
Apr 24 19:58:48 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.756s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:58:48 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Deleted volume successfully.
Apr 24 19:58:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e00b5815-9dab-4e32-8a6a-0443c97698cb tempest-VolumesCloneTest-1190974476 None] Lock "cinder-2c0677b5-10dd-40c4-b569-29324ac76762-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Acquiring lock "cinder-5881155c-1b92-4703-9f57-05fd8f9e7390-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Lock "cinder-5881155c-1b92-4703-9f57-05fd8f9e7390-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Acquiring lock "cinder-quobyte-5881155c-1b92-4703-9f57-05fd8f9e7390" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:58:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Lock "cinder-quobyte-5881155c-1b92-4703-9f57-05fd8f9e7390" acquired by "delete_volume" :: waited 0.035s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:58:49 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4911edab-5a36-4d32-94f5-436b0dd3bc2e]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:49 devstack sudo[86997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390
Apr 24 19:58:49 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] Creating offline snapshot 2d3f1348-53be-457b-a74f-d3db8e138413 of volume aa7ab613-e69b-4b9b-aea0-e0f11f71c89d {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 19:58:50 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1958559-9033-4f64-b6cc-26c4d84e6ef2]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:58:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:50 devstack sudo[87001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d
Apr 24 19:58:50 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:50 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390" returned: 0 in 0.997s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:50 devstack sudo[87007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390
Apr 24 19:58:50 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:50 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d" returned: 0 in 0.781s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:50 devstack sudo[87012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413 1G
Apr 24 19:58:50 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:51 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5881155c-1b92-4703-9f57-05fd8f9e7390" returned: 0 in 0.616s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:51 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Lock "cinder-quobyte-5881155c-1b92-4703-9f57-05fd8f9e7390" released by "delete_volume" :: held 1.722s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:51 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Created reservations ['e7d66e4d-88f0-46b6-ba61-e40c29fb8ac8', '2dfc3a19-d98a-47b0-abd4-90bfdfeff135', 'b7c36c94-9db0-45b2-8bc0-7d6bfe053e65', 'f38e6e13-cc94-47ba-850b-0566641491dd'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:58:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:51 devstack sudo[87015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:58:51 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:51 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413 1G" returned: 0 in 1.113s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:51 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.687s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:51 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:58:51 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Deleted volume successfully.
Apr 24 19:58:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7259c7e8-c935-4912-896d-93f3abe7a169 tempest-VolumesCloneTest-1190974476 None] Lock "cinder-5881155c-1b92-4703-9f57-05fd8f9e7390-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:58:52 devstack sudo[87021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413
Apr 24 19:58:52 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:52 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413" returned: 0 in 0.835s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:52 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413 is being set with open permissions: ugo+rw
Apr 24 19:58:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:52 devstack sudo[87026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413
Apr 24 19:58:52 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:53 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413" returned: 0 in 0.765s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:53 devstack sudo[87032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.info
Apr 24 19:58:53 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:54 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.info" returned: 0 in 0.741s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:54 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.info is being set with open permissions: ugo+rw
Apr 24 19:58:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:54 devstack sudo[87036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.info
Apr 24 19:58:54 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:55 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.info" returned: 0 in 0.865s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.254s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:55 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-eb7b1bec-f9f4-4be9-9e20-13637274891a tempest-CreateVolumesFromSnapshotTest-953738396 None] Create snapshot completed successfully
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Flow 'volume_create_manager' (54a0c5d5-51b9-40d6-910a-9e98ea8c1b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0b5254-a322-456e-a40d-836e39082603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0b5254-a322-456e-a40d-836e39082603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1736287577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916809c7-b75a-43e7-98e8-76199da773be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4e3b3b9efa2413fb33b30c7478240ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:56Z,use_quota=True,user_id='bf8e2b5a3a2944b1a89fa4cde41da73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c5bec1-ffc7-453e-b459-30d3f4df5820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c5bec1-ffc7-453e-b459-30d3f4df5820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd278d6-eef6-49c7-8bec-4a14bfdd3b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd278d6-eef6-49c7-8bec-4a14bfdd3b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '916809c7-b75a-43e7-98e8-76199da773be', 'volume_name': 'volume-916809c7-b75a-43e7-98e8-76199da773be', 'volume_size': 2}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d93880-96f9-4ca7-bde4-f2929262c2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d93880-96f9-4ca7-bde4-f2929262c2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144da4be-486e-466d-ac18-400f1e6289d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:56 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Volume 916809c7-b75a-43e7-98e8-76199da773be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-916809c7-b75a-43e7-98e8-76199da773be', 'volume_size': 2}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1736287577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916809c7-b75a-43e7-98e8-76199da773be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4e3b3b9efa2413fb33b30c7478240ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:56Z,use_quota=True,user_id='bf8e2b5a3a2944b1a89fa4cde41da73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Creating volume 916809c7-b75a-43e7-98e8-76199da773be {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:58:56 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be 2147483648 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:56 devstack sudo[87039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be 2147483648
Apr 24 19:58:56 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:56 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Flow 'volume_create_manager' (1253d7c8-c20a-400c-8f88-8a406781bb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd69e134-7e92-4e17-a3f3-cbc1154941ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd69e134-7e92-4e17-a3f3-cbc1154941ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-607773479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2439a2-df5b-448d-b969-a4d88a8f6bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b38275501141a1bea116ebf6e9a40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:57Z,use_quota=True,user_id='9f4515f660f449228f2284e69295d2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45226dd5-cc3e-4ac8-85fb-1f73fd25a82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45226dd5-cc3e-4ac8-85fb-1f73fd25a82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fa1fde-6f12-4ae2-b7b1-d08c5a58b7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fa1fde-6f12-4ae2-b7b1-d08c5a58b7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db2439a2-df5b-448d-b969-a4d88a8f6bd0', 'volume_name': 'volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288224d9-76d6-44d0-bf8c-4ddcbcbfd0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288224d9-76d6-44d0-bf8c-4ddcbcbfd0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383422a8-52c2-4951-b7ac-462cf9ff47f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:57 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume db2439a2-df5b-448d-b969-a4d88a8f6bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0', 'volume_size': 1}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Flow 'volume_create_manager' (40aca3bc-6cfc-4429-937f-0821d01b9a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56818e21-7da5-453d-ae02-a88e8bf29c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56818e21-7da5-453d-ae02-a88e8bf29c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-293254922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18adf1ae-ff29-4ce4-a99e-83177b635a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b38275501141a1bea116ebf6e9a40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:57Z,use_quota=True,user_id='9f4515f660f449228f2284e69295d2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abdd26e-0e9c-4da4-a9a1-ef7de0ec0430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abdd26e-0e9c-4da4-a9a1-ef7de0ec0430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e246a165-92d4-4fb4-8f14-99e324817518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e246a165-92d4-4fb4-8f14-99e324817518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18adf1ae-ff29-4ce4-a99e-83177b635a61', 'volume_name': 'volume-18adf1ae-ff29-4ce4-a99e-83177b635a61', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe7c3c8-1897-4088-ba87-01bba28be965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe7c3c8-1897-4088-ba87-01bba28be965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bcfe87-85da-49d3-a43b-f01a51b7786a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:57 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume 18adf1ae-ff29-4ce4-a99e-83177b635a61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18adf1ae-ff29-4ce4-a99e-83177b635a61', 'volume_size': 1}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:57 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be 2147483648" returned: 0 in 1.731s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Flow 'volume_create_manager' (a232906f-feb3-4495-b25a-b6c7ee5f0edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0e099c-be7f-499e-9111-b16936a3c7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0e099c-be7f-499e-9111-b16936a3c7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1652964240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eadd84ae-4748-4664-b64c-1e103a47beaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b38275501141a1bea116ebf6e9a40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:58Z,use_quota=True,user_id='9f4515f660f449228f2284e69295d2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b589a197-75cc-48b2-abb3-219c07f105b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b589a197-75cc-48b2-abb3-219c07f105b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12faca38-5760-44fb-8c46-12aa357c37a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12faca38-5760-44fb-8c46-12aa357c37a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eadd84ae-4748-4664-b64c-1e103a47beaf', 'volume_name': 'volume-eadd84ae-4748-4664-b64c-1e103a47beaf', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06a22a1-5188-4932-9bba-cf7cb1e3f3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06a22a1-5188-4932-9bba-cf7cb1e3f3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db5a130-fc50-4607-9d98-2c0492bf1b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:58 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume eadd84ae-4748-4664-b64c-1e103a47beaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eadd84ae-4748-4664-b64c-1e103a47beaf', 'volume_size': 1}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:58 devstack sudo[87060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be
Apr 24 19:58:58 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Flow 'volume_create_manager' (7b404ed4-1811-4563-a30e-74b836e63d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e596ed9-153f-4f1d-b7ff-4ce31ed787c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e596ed9-153f-4f1d-b7ff-4ce31ed787c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1911137311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d5193e-004b-4f32-8035-cd54b233e077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b38275501141a1bea116ebf6e9a40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:58Z,use_quota=True,user_id='9f4515f660f449228f2284e69295d2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68f8e74-0423-40b0-9dd9-6dc6bb7a4741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68f8e74-0423-40b0-9dd9-6dc6bb7a4741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c326c1f-b26e-4f36-86e6-397430c50613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c326c1f-b26e-4f36-86e6-397430c50613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d5193e-004b-4f32-8035-cd54b233e077', 'volume_name': 'volume-a3d5193e-004b-4f32-8035-cd54b233e077', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14f9705-8e6f-4303-a3f3-6d37614ce0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14f9705-8e6f-4303-a3f3-6d37614ce0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738c6729-aa66-4d7c-9288-ee8e865f063f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:58 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume a3d5193e-004b-4f32-8035-cd54b233e077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d5193e-004b-4f32-8035-cd54b233e077', 'volume_size': 1}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:58 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be" returned: 0 in 0.709s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] <== create_volume: return (2641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.644s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.539s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-607773479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2439a2-df5b-448d-b969-a4d88a8f6bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b38275501141a1bea116ebf6e9a40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:57Z,use_quota=True,user_id='9f4515f660f449228f2284e69295d2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Creating volume db2439a2-df5b-448d-b969-a4d88a8f6bd0 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:58:58 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144da4be-486e-466d-ac18-400f1e6289d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-916809c7-b75a-43e7-98e8-76199da773be', 'volume_size': 2}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:58 devstack sudo[87063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0 1073741824
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a25651e-1695-4c56-8f44-a52c64c87a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:58 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:58:58 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Volume volume-916809c7-b75a-43e7-98e8-76199da773be (916809c7-b75a-43e7-98e8-76199da773be): created successfully
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a25651e-1695-4c56-8f44-a52c64c87a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Flow 'volume_create_manager' (54a0c5d5-51b9-40d6-910a-9e98ea8c1b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:58 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-46414271-5c5f-492f-8e5d-38eeccefc7bd tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Created volume successfully.
Apr 24 19:58:59 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:58:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Flow 'volume_create_manager' (8e323060-567d-4718-8393-43baef6725ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:58:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0690905e-5c6b-485d-bd39-22d135339217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0690905e-5c6b-485d-bd39-22d135339217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-946543275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d5eff8-f633-407a-ac09-fe0bf1379034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b38275501141a1bea116ebf6e9a40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:59Z,use_quota=True,user_id='9f4515f660f449228f2284e69295d2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888f84c6-698c-4169-b1e8-c754b7a3e6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888f84c6-698c-4169-b1e8-c754b7a3e6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5cfb654-1ec9-4f25-8f56-ce14ad58a7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5cfb654-1ec9-4f25-8f56-ce14ad58a7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d5eff8-f633-407a-ac09-fe0bf1379034', 'volume_name': 'volume-c6d5eff8-f633-407a-ac09-fe0bf1379034', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf90e4f-d7c5-4d9b-9c09-09490b9cc8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf90e4f-d7c5-4d9b-9c09-09490b9cc8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:58:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4148abec-1c65-4e7d-84e0-f1b0f27bcb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:58:59 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume c6d5eff8-f633-407a-ac09-fe0bf1379034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d5eff8-f633-407a-ac09-fe0bf1379034', 'volume_size': 1}
Apr 24 19:58:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:58:59 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root
Apr 24 19:58:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0 1073741824" returned: 0 in 1.161s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:00 devstack sudo[87069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0
Apr 24 19:59:00 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:00 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0" returned: 0 in 0.929s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:00 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.475s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:00 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-293254922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18adf1ae-ff29-4ce4-a99e-83177b635a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b38275501141a1bea116ebf6e9a40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:57Z,use_quota=True,user_id='9f4515f660f449228f2284e69295d2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:59:00 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Creating volume 18adf1ae-ff29-4ce4-a99e-83177b635a61 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:59:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:00 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:00 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:00 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:59:00 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:59:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-18adf1ae-ff29-4ce4-a99e-83177b635a61 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383422a8-52c2-4951-b7ac-462cf9ff47f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:01 devstack sudo[87087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-18adf1ae-ff29-4ce4-a99e-83177b635a61 1073741824
Apr 24 19:59:01 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d9987a-a88a-4905-84d1-1a104004f283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:01 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0 (db2439a2-df5b-448d-b969-a4d88a8f6bd0): created successfully
Apr 24 19:59:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d9987a-a88a-4905-84d1-1a104004f283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Flow 'volume_create_manager' (1253d7c8-c20a-400c-8f88-8a406781bb55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:01 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-ca603f7a-6fd4-4793-90af-8451e5898f1f tempest-CreateVolumesFromSnapshotTest-953738396 None] Created volume successfully.
Apr 24 19:59:01 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-18adf1ae-ff29-4ce4-a99e-83177b635a61 1073741824" returned: 0 in 0.979s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-18adf1ae-ff29-4ce4-a99e-83177b635a61 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:02 devstack sudo[87119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-18adf1ae-ff29-4ce4-a99e-83177b635a61
Apr 24 19:59:02 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:02 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-18adf1ae-ff29-4ce4-a99e-83177b635a61" returned: 0 in 0.448s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.397s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1652964240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eadd84ae-4748-4664-b64c-1e103a47beaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b38275501141a1bea116ebf6e9a40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:58Z,use_quota=True,user_id='9f4515f660f449228f2284e69295d2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Creating volume eadd84ae-4748-4664-b64c-1e103a47beaf {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:59:02 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eadd84ae-4748-4664-b64c-1e103a47beaf 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bcfe87-85da-49d3-a43b-f01a51b7786a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18adf1ae-ff29-4ce4-a99e-83177b635a61', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:02 devstack sudo[87122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eadd84ae-4748-4664-b64c-1e103a47beaf 1073741824
Apr 24 19:59:02 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c3cfd0-7439-4fbe-8b0c-8c2633857ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:02 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume volume-18adf1ae-ff29-4ce4-a99e-83177b635a61 (18adf1ae-ff29-4ce4-a99e-83177b635a61): created successfully
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c3cfd0-7439-4fbe-8b0c-8c2633857ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Flow 'volume_create_manager' (40aca3bc-6cfc-4429-937f-0821d01b9a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:02 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d4e2e2e5-ab49-4d40-91f1-3149fedb879d tempest-CreateVolumesFromSnapshotTest-953738396 None] Created volume successfully.
Apr 24 19:59:03 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eadd84ae-4748-4664-b64c-1e103a47beaf 1073741824" returned: 0 in 0.679s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eadd84ae-4748-4664-b64c-1e103a47beaf {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:03 devstack sudo[87127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eadd84ae-4748-4664-b64c-1e103a47beaf
Apr 24 19:59:03 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:03 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eadd84ae-4748-4664-b64c-1e103a47beaf" returned: 0 in 0.433s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.183s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1911137311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d5193e-004b-4f32-8035-cd54b233e077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b38275501141a1bea116ebf6e9a40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:58Z,use_quota=True,user_id='9f4515f660f449228f2284e69295d2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Creating volume a3d5193e-004b-4f32-8035-cd54b233e077 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:59:03 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a3d5193e-004b-4f32-8035-cd54b233e077 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:03 devstack sudo[87133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a3d5193e-004b-4f32-8035-cd54b233e077 1073741824
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db5a130-fc50-4607-9d98-2c0492bf1b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eadd84ae-4748-4664-b64c-1e103a47beaf', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:03 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc4483d-6438-48f2-9c33-f5f90f93592e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:03 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume volume-eadd84ae-4748-4664-b64c-1e103a47beaf (eadd84ae-4748-4664-b64c-1e103a47beaf): created successfully
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc4483d-6438-48f2-9c33-f5f90f93592e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Flow 'volume_create_manager' (a232906f-feb3-4495-b25a-b6c7ee5f0edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:03 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0e95e33d-db7b-43dc-a711-cd8827f3a003 tempest-CreateVolumesFromSnapshotTest-953738396 None] Created volume successfully.
Apr 24 19:59:04 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a3d5193e-004b-4f32-8035-cd54b233e077 1073741824" returned: 0 in 0.765s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a3d5193e-004b-4f32-8035-cd54b233e077 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:04 devstack sudo[87147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a3d5193e-004b-4f32-8035-cd54b233e077
Apr 24 19:59:04 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:04 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a3d5193e-004b-4f32-8035-cd54b233e077" returned: 0 in 0.522s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.707s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-946543275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d5eff8-f633-407a-ac09-fe0bf1379034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b38275501141a1bea116ebf6e9a40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:59Z,use_quota=True,user_id='9f4515f660f449228f2284e69295d2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Creating volume c6d5eff8-f633-407a-ac09-fe0bf1379034 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:59:04 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c6d5eff8-f633-407a-ac09-fe0bf1379034 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738c6729-aa66-4d7c-9288-ee8e865f063f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d5193e-004b-4f32-8035-cd54b233e077', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1aa58a-27bd-467c-a1ec-a8d63173b0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:05 devstack sudo[87169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c6d5eff8-f633-407a-ac09-fe0bf1379034 1073741824
Apr 24 19:59:05 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:05 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume volume-a3d5193e-004b-4f32-8035-cd54b233e077 (a3d5193e-004b-4f32-8035-cd54b233e077): created successfully
Apr 24 19:59:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1aa58a-27bd-467c-a1ec-a8d63173b0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Flow 'volume_create_manager' (7b404ed4-1811-4563-a30e-74b836e63d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:05 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-efc06ccb-6e32-42cd-9f14-3bf6c25ea2c8 tempest-CreateVolumesFromSnapshotTest-953738396 None] Created volume successfully.
Apr 24 19:59:05 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c6d5eff8-f633-407a-ac09-fe0bf1379034 1073741824" returned: 0 in 0.962s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c6d5eff8-f633-407a-ac09-fe0bf1379034 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:05 devstack sudo[87197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c6d5eff8-f633-407a-ac09-fe0bf1379034
Apr 24 19:59:05 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:06 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c6d5eff8-f633-407a-ac09-fe0bf1379034" returned: 0 in 0.563s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.700s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4148abec-1c65-4e7d-84e0-f1b0f27bcb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d5eff8-f633-407a-ac09-fe0bf1379034', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bdcd88b-0dde-4193-8d53-86f718bf4eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Creating offline snapshot 2462227f-c328-4e75-8172-49098cd7abea of volume 916809c7-b75a-43e7-98e8-76199da773be {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 19:59:06 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Volume volume-c6d5eff8-f633-407a-ac09-fe0bf1379034 (c6d5eff8-f633-407a-ac09-fe0bf1379034): created successfully
Apr 24 19:59:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bdcd88b-0dde-4193-8d53-86f718bf4eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Flow 'volume_create_manager' (8e323060-567d-4718-8393-43baef6725ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:06 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9696f07-6bde-4474-818d-1852bf3fc12f]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:06 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-903b2031-9ac2-426f-8f93-e6cb65888e0c tempest-CreateVolumesFromSnapshotTest-953738396 None] Created volume successfully.
Apr 24 19:59:06 devstack sudo[87200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be
Apr 24 19:59:06 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-c6d5eff8-f633-407a-ac09-fe0bf1379034-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-c6d5eff8-f633-407a-ac09-fe0bf1379034-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-quobyte-c6d5eff8-f633-407a-ac09-fe0bf1379034" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-c6d5eff8-f633-407a-ac09-fe0bf1379034" acquired by "delete_volume" :: waited 0.062s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:07 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef1c522-5598-4219-a31b-979059bd8788]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c6d5eff8-f633-407a-ac09-fe0bf1379034 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:07 devstack sudo[87209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c6d5eff8-f633-407a-ac09-fe0bf1379034
Apr 24 19:59:07 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:07 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be" returned: 0 in 1.181s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea 2G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:07 devstack sudo[87219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea 2G
Apr 24 19:59:07 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:08 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c6d5eff8-f633-407a-ac09-fe0bf1379034" returned: 0 in 0.930s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c6d5eff8-f633-407a-ac09-fe0bf1379034 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:08 devstack sudo[87227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c6d5eff8-f633-407a-ac09-fe0bf1379034
Apr 24 19:59:08 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:08 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c6d5eff8-f633-407a-ac09-fe0bf1379034" returned: 0 in 0.729s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:08 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-c6d5eff8-f633-407a-ac09-fe0bf1379034" released by "delete_volume" :: held 1.761s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:09 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Created reservations ['4f027b3d-7512-4a1c-9cca-4ced0afa9330', '277d389f-bed4-4f02-9cf7-8d2b8b62312b', '0b8130fa-0b74-4b81-91d1-f9ea2e343287', '41cde5bd-042c-4c77-af55-5f1ce0cc5b6e'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:09 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea 2G" returned: 0 in 1.335s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916809c7-b75a-43e7-98e8-76199da773be -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-de69819d-7fd9-412c-a657-c2122b8ba8af tempest-VolumesActionsTest-1357342770 None] Acquiring lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" by "attach_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:09 devstack sudo[87262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916809c7-b75a-43e7-98e8-76199da773be -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea
Apr 24 19:59:09 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-de69819d-7fd9-412c-a657-c2122b8ba8af tempest-VolumesActionsTest-1357342770 None] Lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" acquired by "attach_volume" :: waited 0.087s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:09 devstack sudo[87264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:09 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-a3d5193e-004b-4f32-8035-cd54b233e077-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-a3d5193e-004b-4f32-8035-cd54b233e077-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-quobyte-a3d5193e-004b-4f32-8035-cd54b233e077" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:10 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-de69819d-7fd9-412c-a657-c2122b8ba8af tempest-VolumesActionsTest-1357342770 None] Attaching volume cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b to instance b533ddd4-9f00-4cfb-b5ef-299ba02ab6b0 at mountpoint /dev/vdb on host None.
Apr 24 19:59:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-a3d5193e-004b-4f32-8035-cd54b233e077" acquired by "delete_volume" :: waited 0.061s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:10 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-de69819d-7fd9-412c-a657-c2122b8ba8af tempest-VolumesActionsTest-1357342770 None] Attach volume completed successfully.
Apr 24 19:59:10 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6613e53f-d550-4d75-a117-265ca25d257c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a3d5193e-004b-4f32-8035-cd54b233e077 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-de69819d-7fd9-412c-a657-c2122b8ba8af tempest-VolumesActionsTest-1357342770 None] Lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" released by "attach_volume" :: held 1.026s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:10 devstack sudo[87272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a3d5193e-004b-4f32-8035-cd54b233e077
Apr 24 19:59:10 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:11 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3d2a5cef-a9e0-4cf8-8e9e-e66373a02656 tempest-VolumesActionsTest-1357342770 None] Acquiring lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b-detach_volume" by "detach_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.457s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:11 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:11 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Deleted volume successfully.
Apr 24 19:59:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3d2a5cef-a9e0-4cf8-8e9e-e66373a02656 tempest-VolumesActionsTest-1357342770 None] Lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b-detach_volume" acquired by "detach_volume" :: waited 0.056s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:11 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-3d2a5cef-a9e0-4cf8-8e9e-e66373a02656 tempest-VolumesActionsTest-1357342770 None] Detaching volume cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b from instance b533ddd4-9f00-4cfb-b5ef-299ba02ab6b0.
Apr 24 19:59:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a47c80ec-6957-4ccd-9d83-e56f8fe74f02 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-c6d5eff8-f633-407a-ac09-fe0bf1379034-delete_volume" released by "delete_volume" :: held 4.364s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:11 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-3d2a5cef-a9e0-4cf8-8e9e-e66373a02656 tempest-VolumesActionsTest-1357342770 None] Detach volume completed successfully.
Apr 24 19:59:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3d2a5cef-a9e0-4cf8-8e9e-e66373a02656 tempest-VolumesActionsTest-1357342770 None] Lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b-detach_volume" released by "detach_volume" :: held 0.359s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:11 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916809c7-b75a-43e7-98e8-76199da773be -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea" returned: 0 in 2.430s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:11 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea is being set with open permissions: ugo+rw
Apr 24 19:59:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:11 devstack sudo[87287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea
Apr 24 19:59:11 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:12 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a3d5193e-004b-4f32-8035-cd54b233e077" returned: 0 in 2.320s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a3d5193e-004b-4f32-8035-cd54b233e077 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:12 devstack sudo[87299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a3d5193e-004b-4f32-8035-cd54b233e077
Apr 24 19:59:12 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:13 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea" returned: 0 in 1.679s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:13 devstack sudo[87312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.info
Apr 24 19:59:13 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:13 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-a3d5193e-004b-4f32-8035-cd54b233e077" returned: 0 in 1.027s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:13 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-a3d5193e-004b-4f32-8035-cd54b233e077" released by "delete_volume" :: held 3.656s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:13 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Created reservations ['8a11e872-a761-4879-b243-c2aabae846d4', 'f484a43d-8e5e-4013-9c33-9fc3393584b3', 'fe85ed91-abde-45dd-bc52-21111c8fcd1a', 'a3fb477d-8120-4d6e-9f77-bc9326b8082f'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:14 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:14 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:14 devstack sudo[87356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:14 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:14 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.info" returned: 0 in 1.203s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:14 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.info is being set with open permissions: ugo+rw
Apr 24 19:59:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:14 devstack sudo[87383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.info
Apr 24 19:59:14 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:14 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-eadd84ae-4748-4664-b64c-1e103a47beaf-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:14 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-eadd84ae-4748-4664-b64c-1e103a47beaf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:15 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.025s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-quobyte-eadd84ae-4748-4664-b64c-1e103a47beaf" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:15 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Deleted volume successfully.
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-48f34845-b3d7-4e3c-8e56-b0757bc03239 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-a3d5193e-004b-4f32-8035-cd54b233e077-delete_volume" released by "delete_volume" :: held 5.226s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-eadd84ae-4748-4664-b64c-1e103a47beaf" acquired by "delete_volume" :: waited 0.042s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a0c423-b496-4ea9-af68-dd53fca1b713]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eadd84ae-4748-4664-b64c-1e103a47beaf {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:15 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.info" returned: 0 in 0.701s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:15 devstack sudo[87389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eadd84ae-4748-4664-b64c-1e103a47beaf
Apr 24 19:59:15 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.739s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:15 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-892c8d73-52f1-4212-9217-48ff0cf82a24 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Create snapshot completed successfully
Apr 24 19:59:15 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eadd84ae-4748-4664-b64c-1e103a47beaf" returned: 0 in 0.583s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eadd84ae-4748-4664-b64c-1e103a47beaf {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:15 devstack sudo[87397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eadd84ae-4748-4664-b64c-1e103a47beaf
Apr 24 19:59:15 devstack sudo[87397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Acquiring lock "cinder-2462227f-c328-4e75-8172-49098cd7abea-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "cinder-2462227f-c328-4e75-8172-49098cd7abea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Acquiring lock "cinder-quobyte-916809c7-b75a-43e7-98e8-76199da773be" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "cinder-quobyte-916809c7-b75a-43e7-98e8-76199da773be" acquired by "delete_snapshot" :: waited 0.039s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Acquiring lock "cinder-quobyte-2462227f-c328-4e75-8172-49098cd7abea" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "cinder-quobyte-2462227f-c328-4e75-8172-49098cd7abea" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Deleting offline snapshot 2462227f-c328-4e75-8172-49098cd7abea of volume 916809c7-b75a-43e7-98e8-76199da773be {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] snapshot_file for this snap is: volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[37637457-7bd2-410e-99cd-5346a140ee0b]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:16 devstack sudo[87399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea
Apr 24 19:59:16 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:16 devstack sudo[87397]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-eadd84ae-4748-4664-b64c-1e103a47beaf" returned: 0 in 0.866s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-eadd84ae-4748-4664-b64c-1e103a47beaf" released by "delete_volume" :: held 1.510s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Created reservations ['1241b4cd-dafc-4f26-bcad-79c05cd309f6', '3c2ec6e8-0f9c-49da-a121-0bcfd09633af', '37b01aeb-004d-40cb-8c41-fbef6492cc67', 'e01615fa-2a18-47ff-87bd-2d4353ee942e'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:16 devstack sudo[87407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:16 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:16 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea" returned: 0 in 0.796s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-916809c7-b75a-43e7-98e8-76199da773be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb840d4-b890-4611-a843-acb3a50953f5]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:16 devstack sudo[87409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be
Apr 24 19:59:16 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:17 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-18adf1ae-ff29-4ce4-a99e-83177b635a61-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:17 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-18adf1ae-ff29-4ce4-a99e-83177b635a61-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:17 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.583s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:17 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:17 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-quobyte-18adf1ae-ff29-4ce4-a99e-83177b635a61" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:17 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Deleted volume successfully.
Apr 24 19:59:17 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-18adf1ae-ff29-4ce4-a99e-83177b635a61" acquired by "delete_volume" :: waited 0.028s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:17 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c432cd03-78c6-4869-9f7f-f08f537bfc41 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-eadd84ae-4748-4664-b64c-1e103a47beaf-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:17 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7756818c-8db4-43ef-81cf-9afe3229319d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-18adf1ae-ff29-4ce4-a99e-83177b635a61 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:17 devstack sudo[87415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-18adf1ae-ff29-4ce4-a99e-83177b635a61
Apr 24 19:59:17 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:17 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be" returned: 0 in 0.642s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:17 devstack sudo[87417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea
Apr 24 19:59:17 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:18 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-18adf1ae-ff29-4ce4-a99e-83177b635a61" returned: 0 in 0.672s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-18adf1ae-ff29-4ce4-a99e-83177b635a61 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:18 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea" returned: 0 in 0.592s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:18 devstack sudo[87425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-18adf1ae-ff29-4ce4-a99e-83177b635a61
Apr 24 19:59:18 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:18 devstack sudo[87426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea
Apr 24 19:59:18 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:18 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be.2462227f-c328-4e75-8172-49098cd7abea" returned: 0 in 0.455s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:18 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-18adf1ae-ff29-4ce4-a99e-83177b635a61" returned: 0 in 0.515s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "cinder-quobyte-2462227f-c328-4e75-8172-49098cd7abea" released by "_delete_snapshot" :: held 2.639s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-18adf1ae-ff29-4ce4-a99e-83177b635a61" released by "delete_volume" :: held 1.233s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "cinder-quobyte-916809c7-b75a-43e7-98e8-76199da773be" released by "delete_snapshot" :: held 2.701s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Created reservations ['3b035fd5-407e-4126-9e6a-0dfb400a9ac9', 'ac17a238-59c7-42a9-911a-74268b498ddf', '8a096bbe-6605-47ea-9dc1-ffff8ffb5eb4', 'eca1263f-fca9-41e7-bc68-d2b23d8a2e88'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Created reservations ['8e34d8dc-7160-4c63-bb2e-8199cfc0d228', 'ce0a89f9-863f-46f9-b0aa-2455bf10d7da', '4e39d559-0eda-4e09-b4b4-454a3179f5aa', '6e2aec5d-9df1-4ba5-b1bb-273d25e73f8e'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:18 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Delete snapshot completed successfully.
Apr 24 19:59:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-26972e5a-4fce-4711-9741-53c27f110977 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "cinder-2462227f-c328-4e75-8172-49098cd7abea-delete_snapshot" released by "delete_snapshot" :: held 2.936s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:18 devstack sudo[87437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:18 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Acquiring lock "cinder-916809c7-b75a-43e7-98e8-76199da773be-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "cinder-916809c7-b75a-43e7-98e8-76199da773be-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Acquiring lock "cinder-quobyte-916809c7-b75a-43e7-98e8-76199da773be" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "cinder-quobyte-916809c7-b75a-43e7-98e8-76199da773be" acquired by "delete_volume" :: waited 0.027s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28b6da0-454a-4dd8-969c-b89a275e63a6]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:19 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.529s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:19 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Deleted volume successfully.
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-28806f4b-5ea2-43df-951a-efcf7d21ad12 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-18adf1ae-ff29-4ce4-a99e-83177b635a61-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:19 devstack sudo[87441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be
Apr 24 19:59:19 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-db2439a2-df5b-448d-b969-a4d88a8f6bd0-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-db2439a2-df5b-448d-b969-a4d88a8f6bd0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-quobyte-db2439a2-df5b-448d-b969-a4d88a8f6bd0" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-db2439a2-df5b-448d-b969-a4d88a8f6bd0" acquired by "delete_volume" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d20d1d6-283a-47a3-aef8-892a0c0469a4]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:19 devstack sudo[87443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0
Apr 24 19:59:19 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:19 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be" returned: 0 in 0.605s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:19 devstack sudo[87448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be
Apr 24 19:59:19 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:20 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0" returned: 0 in 0.640s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:20 devstack sudo[87453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0
Apr 24 19:59:20 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:20 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-916809c7-b75a-43e7-98e8-76199da773be" returned: 0 in 0.518s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "cinder-quobyte-916809c7-b75a-43e7-98e8-76199da773be" released by "delete_volume" :: held 1.194s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Created reservations ['8cde76f2-d23e-4693-a05b-3ca7ad75b463', '613f1e0d-5bcf-4bc5-9696-0f073594a19b', '3f2e668c-9969-4bda-858a-928d568d3366', 'b83927cf-b0ed-4d1e-801c-57baa0c2bd56'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:20 devstack sudo[87456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:20 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:20 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-db2439a2-df5b-448d-b969-a4d88a8f6bd0" returned: 0 in 0.553s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-db2439a2-df5b-448d-b969-a4d88a8f6bd0" released by "delete_volume" :: held 1.234s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Created reservations ['7194f5e6-c196-4c0a-83d8-cf955da269aa', '7daee2d2-099b-4a83-a7a8-fc3a31f19dcd', '8b026c51-ab13-49bc-bf68-2fde1ac605c9', 'cfbd242f-2b45-4f26-bb33-edf62eeb1a95'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:20 devstack sudo[87459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:20 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:21 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.532s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:21 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Deleted volume successfully.
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-81a70f50-b88c-4387-b533-56c945318342 tempest-VolumesSnapshotNegativeTestJSON-696267782 None] Lock "cinder-916809c7-b75a-43e7-98e8-76199da773be-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:21 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.623s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:21 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Deleted volume successfully.
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-da1269e7-113b-4539-bf3f-d05bc8bd0f8c tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-db2439a2-df5b-448d-b969-a4d88a8f6bd0-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-2d3f1348-53be-457b-a74f-d3db8e138413-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-2d3f1348-53be-457b-a74f-d3db8e138413-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-quobyte-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d" acquired by "delete_snapshot" :: waited 0.043s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-quobyte-2d3f1348-53be-457b-a74f-d3db8e138413" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-2d3f1348-53be-457b-a74f-d3db8e138413" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Deleting offline snapshot 2d3f1348-53be-457b-a74f-d3db8e138413 of volume aa7ab613-e69b-4b9b-aea0-e0f11f71c89d {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] snapshot_file for this snap is: volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[755707c0-8ab3-497f-8b2a-1979e9a45b50]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:22 devstack sudo[87466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413
Apr 24 19:59:22 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Flow 'volume_create_manager' (5d5de4ba-b997-4daa-b9e7-92b264a94626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677713c8-8e86-4bd4-a9e5-3db82c6498d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677713c8-8e86-4bd4-a9e5-3db82c6498d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-31471242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5303e82e-4450-4599-8f3b-4394b4d04fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5003d361cc4f4b8056e81f1d866faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:22Z,use_quota=True,user_id='d65cd241589e44878fe6d509b330465c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15677e08-e3b9-4544-ad9d-7c0f8365d928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15677e08-e3b9-4544-ad9d-7c0f8365d928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596e1111-b5ce-47aa-bf1e-dd8e7c7b1c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596e1111-b5ce-47aa-bf1e-dd8e7c7b1c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5303e82e-4450-4599-8f3b-4394b4d04fed', 'volume_name': 'volume-5303e82e-4450-4599-8f3b-4394b4d04fed', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4714535-1847-4eef-93f4-ce7594362a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4714535-1847-4eef-93f4-ce7594362a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c62cfe-e90d-4c3c-ab44-5cc8dbf2a51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:22 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Volume 5303e82e-4450-4599-8f3b-4394b4d04fed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5303e82e-4450-4599-8f3b-4394b4d04fed', 'volume_size': 1}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-31471242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5303e82e-4450-4599-8f3b-4394b4d04fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5003d361cc4f4b8056e81f1d866faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:22Z,use_quota=True,user_id='d65cd241589e44878fe6d509b330465c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Creating volume 5303e82e-4450-4599-8f3b-4394b4d04fed {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:59:22 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5303e82e-4450-4599-8f3b-4394b4d04fed 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:22 devstack sudo[87471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5303e82e-4450-4599-8f3b-4394b4d04fed 1073741824
Apr 24 19:59:22 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:22 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413" returned: 0 in 0.792s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aebd8c-5329-4f49-89e3-a06284117b5f]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:22 devstack sudo[87479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d
Apr 24 19:59:22 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:23 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5303e82e-4450-4599-8f3b-4394b4d04fed 1073741824" returned: 0 in 0.768s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5303e82e-4450-4599-8f3b-4394b4d04fed {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:23 devstack sudo[87481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5303e82e-4450-4599-8f3b-4394b4d04fed
Apr 24 19:59:23 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:23 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d" returned: 0 in 0.771s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:23 devstack sudo[87487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413
Apr 24 19:59:23 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:23 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5303e82e-4450-4599-8f3b-4394b4d04fed" returned: 0 in 0.606s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c62cfe-e90d-4c3c-ab44-5cc8dbf2a51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5303e82e-4450-4599-8f3b-4394b4d04fed', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f086d69-be1c-4c2a-a571-96a51ee68b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:23 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Volume volume-5303e82e-4450-4599-8f3b-4394b4d04fed (5303e82e-4450-4599-8f3b-4394b4d04fed): created successfully
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f086d69-be1c-4c2a-a571-96a51ee68b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Flow 'volume_create_manager' (5d5de4ba-b997-4daa-b9e7-92b264a94626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:23 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8eac4423-e664-49e3-982e-69b013a15e1f tempest-ServersNegativeTestJSON-20768092 None] Created volume successfully.
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:24 devstack sudo[87491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:24 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:24 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413" returned: 0 in 0.637s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:24 devstack sudo[87494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413
Apr 24 19:59:24 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:24 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.583s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Flow 'volume_create_manager' (92801829-5f34-411c-b7b2-d8ff7a49ab0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d05ccb-7021-4a65-bc94-b3a3e2485220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d05ccb-7021-4a65-bc94-b3a3e2485220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba9e4081-6e99-4d5d-bffc-3e00505d2b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22023d2d849a444a8120c8ff65c93bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:25Z,use_quota=True,user_id='df65d624467b4a56ba0861a8396ae1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7035693-e2bd-4684-b70c-221edc3f26f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7035693-e2bd-4684-b70c-221edc3f26f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a254eab-a84d-4b8a-92a0-25020f952970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a254eab-a84d-4b8a-92a0-25020f952970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba9e4081-6e99-4d5d-bffc-3e00505d2b1d', 'volume_name': 'volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4e4fe9-ed8e-4d5e-a994-c986fb30fbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4e4fe9-ed8e-4d5e-a994-c986fb30fbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15f2f72-fdc8-43c8-bfd1-835f1e0f764b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:24 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Volume ba9e4081-6e99-4d5d-bffc-3e00505d2b1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d', 'volume_size': 1}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba9e4081-6e99-4d5d-bffc-3e00505d2b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22023d2d849a444a8120c8ff65c93bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:25Z,use_quota=True,user_id='df65d624467b4a56ba0861a8396ae1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Creating volume ba9e4081-6e99-4d5d-bffc-3e00505d2b1d {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:59:24 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:24 devstack sudo[87497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d 1073741824
Apr 24 19:59:24 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:24 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d.2d3f1348-53be-457b-a74f-d3db8e138413" returned: 0 in 0.750s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-2d3f1348-53be-457b-a74f-d3db8e138413" released by "_delete_snapshot" :: held 3.109s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d" released by "delete_snapshot" :: held 3.149s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Created reservations ['c47ddd9b-3f1e-43ef-9ab3-72a89b818db8', 'e99e45e0-ca3e-4821-b095-b463a9ff0e4b', '5bb025bd-f2a9-4cdb-b1c2-3d75322492e6', 'e18ff53d-df61-4381-ba9f-847872c57470'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:25 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Delete snapshot completed successfully.
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0daa9d42-a3d9-40a7-8b96-18d2c8c254bd tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-2d3f1348-53be-457b-a74f-d3db8e138413-delete_snapshot" released by "delete_snapshot" :: held 3.332s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:25 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d 1073741824" returned: 0 in 0.768s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:25 devstack sudo[87503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d
Apr 24 19:59:25 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Flow 'volume_create_manager' (e7d928e8-07ae-4735-bac7-74afd0c36254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a558ba68-75dc-499d-ad32-771550ffd26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a558ba68-75dc-499d-ad32-771550ffd26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-653437975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a71db51-ba22-4cfb-b677-6faf3ea9ccd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5003d361cc4f4b8056e81f1d866faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:26Z,use_quota=True,user_id='d65cd241589e44878fe6d509b330465c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15bdbd4-f532-43e7-acd2-6f56dbfb4070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15bdbd4-f532-43e7-acd2-6f56dbfb4070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced26b19-a009-4add-a446-d47aa242b0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced26b19-a009-4add-a446-d47aa242b0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a71db51-ba22-4cfb-b677-6faf3ea9ccd8', 'volume_name': 'volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726cda38-b16c-4c3c-ba20-79990c5d0522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726cda38-b16c-4c3c-ba20-79990c5d0522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8912e40f-01f4-44e1-a59d-6941c57dbe54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:25 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Volume 1a71db51-ba22-4cfb-b677-6faf3ea9ccd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8', 'volume_size': 1}
Apr 24 19:59:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:26 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d" returned: 0 in 0.502s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.376s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-653437975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a71db51-ba22-4cfb-b677-6faf3ea9ccd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5003d361cc4f4b8056e81f1d866faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:26Z,use_quota=True,user_id='d65cd241589e44878fe6d509b330465c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Creating volume 1a71db51-ba22-4cfb-b677-6faf3ea9ccd8 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:59:26 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:26 devstack sudo[87506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8 1073741824
Apr 24 19:59:26 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15f2f72-fdc8-43c8-bfd1-835f1e0f764b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9c3622-e86d-4284-ad3e-5810341e6ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:26 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Volume volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d (ba9e4081-6e99-4d5d-bffc-3e00505d2b1d): created successfully
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9c3622-e86d-4284-ad3e-5810341e6ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Flow 'volume_create_manager' (92801829-5f34-411c-b7b2-d8ff7a49ab0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:26 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f3c9367d-1c72-4c01-a7cb-d5ecf098e7ce tempest-CinderUnicodeTest-1404994684 None] Created volume successfully.
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "cinder-quobyte-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d" acquired by "delete_volume" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8a9048-77e2-4054-b60c-042c2ff9a27c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:26 devstack sudo[87508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d
Apr 24 19:59:26 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:26 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8 1073741824" returned: 0 in 0.875s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:27 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d" returned: 0 in 0.739s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:27 devstack sudo[87516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8
Apr 24 19:59:27 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:27 devstack sudo[87518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d
Apr 24 19:59:27 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Flow 'volume_create_manager' (b1648d47-2dd4-4853-9781-dfc81811a99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231ee26e-6362-4a48-a083-e53b8c62502a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231ee26e-6362-4a48-a083-e53b8c62502a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-852367584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba445564-0deb-4e27-8e88-fd4f5d95f984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22023d2d849a444a8120c8ff65c93bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:27Z,use_quota=True,user_id='df65d624467b4a56ba0861a8396ae1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d0fcd7-66fb-4988-86a6-c31909cfd4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d0fcd7-66fb-4988-86a6-c31909cfd4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66babb32-7a83-4584-9e34-010c4db6fac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66babb32-7a83-4584-9e34-010c4db6fac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba445564-0deb-4e27-8e88-fd4f5d95f984', 'volume_name': 'volume-ba445564-0deb-4e27-8e88-fd4f5d95f984', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d503e642-4790-4d28-866a-8beebb1ae4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d503e642-4790-4d28-866a-8beebb1ae4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d0a89e-cb97-42dd-915a-9e08db9385af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:27 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Volume ba445564-0deb-4e27-8e88-fd4f5d95f984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba445564-0deb-4e27-8e88-fd4f5d95f984', 'volume_size': 1}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:27 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d" returned: 0 in 0.563s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-quobyte-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d" released by "delete_volume" :: held 1.389s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Created reservations ['eabf1bcb-d06a-4d33-8d1f-543fa92c72f6', '41b85705-fc3f-48b7-bc6f-b4c5945aef58', 'd3ab4215-9e84-4bf0-9fb7-b282b52a7283', '610623d0-2c7d-44e7-a380-acd4e851f44d'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:27 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8" returned: 0 in 0.754s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.227s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-852367584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba445564-0deb-4e27-8e88-fd4f5d95f984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22023d2d849a444a8120c8ff65c93bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:27Z,use_quota=True,user_id='df65d624467b4a56ba0861a8396ae1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Creating volume ba445564-0deb-4e27-8e88-fd4f5d95f984 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:59:27 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:27 devstack sudo[87524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984 1073741824
Apr 24 19:59:27 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8912e40f-01f4-44e1-a59d-6941c57dbe54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815ff7b4-0d6d-476a-88bd-4aada18be278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:27 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Volume volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8 (1a71db51-ba22-4cfb-b677-6faf3ea9ccd8): created successfully
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815ff7b4-0d6d-476a-88bd-4aada18be278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Flow 'volume_create_manager' (e7d928e8-07ae-4735-bac7-74afd0c36254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:27 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c59d5210-bf3d-4d75-a338-c28ed113a480 tempest-ServersNegativeTestJSON-20768092 None] Created volume successfully.
Apr 24 19:59:27 devstack sudo[87527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:27 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:28 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.651s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:28 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:28 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Deleted volume successfully.
Apr 24 19:59:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f696d5d7-6240-487c-904c-3ba1456488d6 tempest-CreateVolumesFromSnapshotTest-953738396 None] Lock "cinder-aa7ab613-e69b-4b9b-aea0-e0f11f71c89d-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:28 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984 1073741824" returned: 0 in 0.894s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:28 devstack sudo[87548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984
Apr 24 19:59:28 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:29 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984" returned: 0 in 0.684s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d0a89e-cb97-42dd-915a-9e08db9385af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba445564-0deb-4e27-8e88-fd4f5d95f984', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684bcbf8-be1a-49d9-90e5-2bb7a781da3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:29 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Volume volume-ba445564-0deb-4e27-8e88-fd4f5d95f984 (ba445564-0deb-4e27-8e88-fd4f5d95f984): created successfully
Apr 24 19:59:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684bcbf8-be1a-49d9-90e5-2bb7a781da3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Flow 'volume_create_manager' (b1648d47-2dd4-4853-9781-dfc81811a99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:29 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-9beb6f1f-77ed-455e-a8d1-4f690aa1390e tempest-CinderUnicodeTest-1404994684 None] Created volume successfully.
Apr 24 19:59:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Acquiring lock "cinder-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Lock "cinder-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Acquiring lock "cinder-quobyte-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Lock "cinder-quobyte-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8" acquired by "delete_volume" :: waited 0.023s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:29 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[14016a9c-80e5-4f41-a397-70a25b066997]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:29 devstack sudo[87552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8
Apr 24 19:59:29 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:30 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8" returned: 0 in 0.671s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:30 devstack sudo[87557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8
Apr 24 19:59:30 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:30 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8" returned: 0 in 0.567s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Lock "cinder-quobyte-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8" released by "delete_volume" :: held 1.294s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] Creating offline snapshot d8931153-dc64-44ed-8698-4c1e32af167b of volume ba445564-0deb-4e27-8e88-fd4f5d95f984 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 19:59:30 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cc8c44-8d7b-4f67-8dd0-5030bfddc990]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:30 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Created reservations ['ed35fc13-9fbc-4763-a7ba-2cdc08f3d27e', '3be22a99-8b37-4ab8-a12e-55c16ffc385a', 'b408614f-4657-41bc-8d09-aff36c3cf517', '6cd42d24-c339-42f0-a41e-a8adb71d0891'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:31 devstack sudo[87560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984
Apr 24 19:59:31 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:31 devstack sudo[87562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:31 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Flow 'volume_create_manager' (0b7ee0c1-8a6c-4b1f-8f0f-68f3424215e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6699de58-cebd-4d3f-b4fd-7e7235cf1a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6699de58-cebd-4d3f-b4fd-7e7235cf1a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2007422214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5898cfc-8641-4961-8270-7d75ae86ba15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994b37fb08b6446b8c6c7d40e22b463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:31Z,use_quota=True,user_id='a8e5cadd190e4756a80390477938a926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26fc106-1327-4a16-a5cb-74488534cda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26fc106-1327-4a16-a5cb-74488534cda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3be60a-dfa9-47b3-963a-540a2e107540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3be60a-dfa9-47b3-963a-540a2e107540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5898cfc-8641-4961-8270-7d75ae86ba15', 'volume_name': 'volume-d5898cfc-8641-4961-8270-7d75ae86ba15', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9460ddd-2310-4610-a17e-7c2d8f608659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9460ddd-2310-4610-a17e-7c2d8f608659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be6ba1d-ccb6-4d5c-85cd-5c3ca7fef989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:31 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume d5898cfc-8641-4961-8270-7d75ae86ba15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5898cfc-8641-4961-8270-7d75ae86ba15', 'volume_size': 1}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:31 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.558s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:31 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:31 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Deleted volume successfully.
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984" returned: 0 in 0.693s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f575451d-c5fb-4258-a39a-035bfc0ee961 tempest-ServersNegativeTestJSON-20768092 None] Lock "cinder-1a71db51-ba22-4cfb-b677-6faf3ea9ccd8-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:31 devstack sudo[87572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b 1G
Apr 24 19:59:31 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Acquiring lock "cinder-5303e82e-4450-4599-8f3b-4394b4d04fed-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Lock "cinder-5303e82e-4450-4599-8f3b-4394b4d04fed-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Acquiring lock "cinder-quobyte-5303e82e-4450-4599-8f3b-4394b4d04fed" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Lock "cinder-quobyte-5303e82e-4450-4599-8f3b-4394b4d04fed" acquired by "delete_volume" :: waited 0.025s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad1cc5e-6611-4a45-b1cd-54fae1c288df]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5303e82e-4450-4599-8f3b-4394b4d04fed {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:31 devstack sudo[87574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5303e82e-4450-4599-8f3b-4394b4d04fed
Apr 24 19:59:31 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:32 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b 1G" returned: 0 in 0.708s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba445564-0deb-4e27-8e88-fd4f5d95f984 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:32 devstack sudo[87584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba445564-0deb-4e27-8e88-fd4f5d95f984 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b
Apr 24 19:59:32 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:32 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5303e82e-4450-4599-8f3b-4394b4d04fed" returned: 0 in 0.641s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5303e82e-4450-4599-8f3b-4394b4d04fed {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:32 devstack sudo[87586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5303e82e-4450-4599-8f3b-4394b4d04fed
Apr 24 19:59:32 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:32 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba445564-0deb-4e27-8e88-fd4f5d95f984 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b" returned: 0 in 0.473s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:32 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b is being set with open permissions: ugo+rw
Apr 24 19:59:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:32 devstack sudo[87591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b
Apr 24 19:59:32 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:32 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5303e82e-4450-4599-8f3b-4394b4d04fed" returned: 0 in 0.479s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Lock "cinder-quobyte-5303e82e-4450-4599-8f3b-4394b4d04fed" released by "delete_volume" :: held 1.161s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:32 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Created reservations ['6d426984-ebcf-4a0b-b1f5-c461c0e4a0b5', 'e921f51e-8b4b-4e98-be9a-71061321b643', '4410070d-87af-44c2-b3b3-65d54a8f7ade', '5843c83c-1c3c-4875-a13d-d189d7989e01'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:33 devstack sudo[87594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:33 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:33 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b" returned: 0 in 0.451s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:33 devstack sudo[87600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.info
Apr 24 19:59:33 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:33 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.477s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:33 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:33 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Deleted volume successfully.
Apr 24 19:59:33 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f6326d3b-2214-465a-b403-afa5452616b4 tempest-ServersNegativeTestJSON-20768092 None] Lock "cinder-5303e82e-4450-4599-8f3b-4394b4d04fed-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:33 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.info" returned: 0 in 0.520s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:33 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.info is being set with open permissions: ugo+rw
Apr 24 19:59:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:33 devstack sudo[87611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.info
Apr 24 19:59:33 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:34 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.info" returned: 0 in 0.644s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.600s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.985s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2007422214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5898cfc-8641-4961-8270-7d75ae86ba15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994b37fb08b6446b8c6c7d40e22b463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:31Z,use_quota=True,user_id='a8e5cadd190e4756a80390477938a926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:59:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Creating volume d5898cfc-8641-4961-8270-7d75ae86ba15 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:59:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:59:34 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:59:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d5898cfc-8641-4961-8270-7d75ae86ba15 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:34 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-5c508e24-6720-4a45-8b91-8d4b304d4d63 tempest-CinderUnicodeTest-1404994684 None] Create snapshot completed successfully
Apr 24 19:59:34 devstack sudo[87634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d5898cfc-8641-4961-8270-7d75ae86ba15 1073741824
Apr 24 19:59:34 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:35 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Acquiring lock "cinder-d8931153-dc64-44ed-8698-4c1e32af167b-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:35 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Lock "cinder-d8931153-dc64-44ed-8698-4c1e32af167b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:35 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Acquiring lock "cinder-quobyte-ba445564-0deb-4e27-8e88-fd4f5d95f984" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:35 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Lock "cinder-quobyte-ba445564-0deb-4e27-8e88-fd4f5d95f984" acquired by "delete_snapshot" :: waited 0.055s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:35 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Acquiring lock "cinder-quobyte-d8931153-dc64-44ed-8698-4c1e32af167b" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:35 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Lock "cinder-quobyte-d8931153-dc64-44ed-8698-4c1e32af167b" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Deleting offline snapshot d8931153-dc64-44ed-8698-4c1e32af167b of volume ba445564-0deb-4e27-8e88-fd4f5d95f984 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 19:59:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] snapshot_file for this snap is: volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 19:59:35 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73be17b-822e-4c99-a872-ff23efb1cbd8]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:35 devstack sudo[87661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b
Apr 24 19:59:35 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:35 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d5898cfc-8641-4961-8270-7d75ae86ba15 1073741824" returned: 0 in 1.397s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d5898cfc-8641-4961-8270-7d75ae86ba15 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:36 devstack sudo[87679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d5898cfc-8641-4961-8270-7d75ae86ba15
Apr 24 19:59:36 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:36 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b" returned: 0 in 1.274s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:36 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba445564-0deb-4e27-8e88-fd4f5d95f984(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 19:59:36 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b652a71-a42b-4508-83bb-31d0668b67ed]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:36 devstack sudo[87686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984
Apr 24 19:59:36 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:37 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d5898cfc-8641-4961-8270-7d75ae86ba15" returned: 0 in 1.026s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] <== create_volume: return (2508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.512s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be6ba1d-ccb6-4d5c-85cd-5c3ca7fef989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5898cfc-8641-4961-8270-7d75ae86ba15', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b68ff3-1188-4401-83d7-e43a99624f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:37 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume volume-d5898cfc-8641-4961-8270-7d75ae86ba15 (d5898cfc-8641-4961-8270-7d75ae86ba15): created successfully
Apr 24 19:59:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b68ff3-1188-4401-83d7-e43a99624f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:37 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Flow 'volume_create_manager' (0b7ee0c1-8a6c-4b1f-8f0f-68f3424215e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:37 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-fdbb56cb-d564-499d-a598-7d070f3bc719 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Created volume successfully.
Apr 24 19:59:37 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984" returned: 0 in 0.868s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:37 devstack sudo[87693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b
Apr 24 19:59:37 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8058dbd9-55b8-47a5-83f4-66c91f152f05 tempest-VolumesActionsTest-1357342770 None] Acquiring lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" by "attach_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8058dbd9-55b8-47a5-83f4-66c91f152f05 tempest-VolumesActionsTest-1357342770 None] Lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" acquired by "attach_volume" :: waited 0.036s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:38 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8058dbd9-55b8-47a5-83f4-66c91f152f05 tempest-VolumesActionsTest-1357342770 None] Attaching volume cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b to instance e659c0d0-2024-4c92-bfb5-e413e6432207 at mountpoint /dev/vdb on host None.
Apr 24 19:59:38 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8058dbd9-55b8-47a5-83f4-66c91f152f05 tempest-VolumesActionsTest-1357342770 None] Attach volume completed successfully.
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8058dbd9-55b8-47a5-83f4-66c91f152f05 tempest-VolumesActionsTest-1357342770 None] Lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" released by "attach_volume" :: held 0.145s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:59:38 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Flow 'volume_create_manager' (970d43e5-66dc-4761-a07b-d973d5b17c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda7b80d-a07d-43ba-a2e1-de19a8721716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b" returned: 0 in 1.074s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:38 devstack sudo[87699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b
Apr 24 19:59:38 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda7b80d-a07d-43ba-a2e1-de19a8721716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-209574635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208511c4-9ae4-4895-a65b-1b336c8995c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994b37fb08b6446b8c6c7d40e22b463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:39Z,use_quota=True,user_id='a8e5cadd190e4756a80390477938a926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96783fd-e016-4c1e-8d15-4d23d805da90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96783fd-e016-4c1e-8d15-4d23d805da90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ca4229-fcba-446c-910d-ccf294ff3076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ca4229-fcba-446c-910d-ccf294ff3076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208511c4-9ae4-4895-a65b-1b336c8995c4', 'volume_name': 'volume-208511c4-9ae4-4895-a65b-1b336c8995c4', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e261594-61e3-4652-9f21-256d1034f04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e261594-61e3-4652-9f21-256d1034f04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a498c6a-3c5d-4fb7-b031-73c3402a8902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:38 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume 208511c4-9ae4-4895-a65b-1b336c8995c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208511c4-9ae4-4895-a65b-1b336c8995c4', 'volume_size': 1}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-209574635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208511c4-9ae4-4895-a65b-1b336c8995c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994b37fb08b6446b8c6c7d40e22b463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:39Z,use_quota=True,user_id='a8e5cadd190e4756a80390477938a926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Creating volume 208511c4-9ae4-4895-a65b-1b336c8995c4 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:59:38 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:59:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-208511c4-9ae4-4895-a65b-1b336c8995c4 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:38 devstack sudo[87701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-208511c4-9ae4-4895-a65b-1b336c8995c4 1073741824
Apr 24 19:59:38 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8ad5c9a9-c8e7-41b5-9490-ebf56b988083 tempest-VolumesActionsTest-1357342770 None] Acquiring lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b-detach_volume" by "detach_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Flow 'volume_create_manager' (ca1a28e8-35ea-43e0-bfcd-98dd03f7c7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e1a12c-dd6a-4d5b-997b-05b8d5f92009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8ad5c9a9-c8e7-41b5-9490-ebf56b988083 tempest-VolumesActionsTest-1357342770 None] Lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b-detach_volume" acquired by "detach_volume" :: waited 0.155s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:39 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8ad5c9a9-c8e7-41b5-9490-ebf56b988083 tempest-VolumesActionsTest-1357342770 None] Detaching volume cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b from instance e659c0d0-2024-4c92-bfb5-e413e6432207.
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e1a12c-dd6a-4d5b-997b-05b8d5f92009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000005338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994b37fb08b6446b8c6c7d40e22b463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:39Z,use_quota=True,user_id='a8e5cadd190e4756a80390477938a926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8437b77b-4b4a-4823-9d57-723fb003e5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8437b77b-4b4a-4823-9d57-723fb003e5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc784864-6a82-4e5f-9644-a938836446a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc784864-6a82-4e5f-9644-a938836446a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8', 'volume_name': 'volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa3f73d-c006-49e5-91d7-4e7f16249161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa3f73d-c006-49e5-91d7-4e7f16249161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd291a4-23ca-4b66-b8df-7d537e5ab9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:39 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8', 'volume_size': 1}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:39 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8ad5c9a9-c8e7-41b5-9490-ebf56b988083 tempest-VolumesActionsTest-1357342770 None] Detach volume completed successfully.
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8ad5c9a9-c8e7-41b5-9490-ebf56b988083 tempest-VolumesActionsTest-1357342770 None] Lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b-detach_volume" released by "detach_volume" :: held 0.185s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Flow 'volume_create_manager' (7bd1d6ef-2311-4e2f-9ae9-90230b879004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18619c2c-9f93-4677-9422-2007743a29d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18619c2c-9f93-4677-9422-2007743a29d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-179614298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660e863a-f607-4ee8-b38e-a04e59688268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994b37fb08b6446b8c6c7d40e22b463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:40Z,use_quota=True,user_id='a8e5cadd190e4756a80390477938a926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc44b64f-8699-4c18-b7c3-c90e7917c9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc44b64f-8699-4c18-b7c3-c90e7917c9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b91478-962a-49d9-af1b-32f19eeacea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b91478-962a-49d9-af1b-32f19eeacea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '660e863a-f607-4ee8-b38e-a04e59688268', 'volume_name': 'volume-660e863a-f607-4ee8-b38e-a04e59688268', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5143331-f39e-4703-9289-85dd04969910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5143331-f39e-4703-9289-85dd04969910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e10bb3-26d3-4a0d-87e5-06f8338d0c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:39 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume 660e863a-f607-4ee8-b38e-a04e59688268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-660e863a-f607-4ee8-b38e-a04e59688268', 'volume_size': 1}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:39 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984.d8931153-dc64-44ed-8698-4c1e32af167b" returned: 0 in 1.234s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Lock "cinder-quobyte-d8931153-dc64-44ed-8698-4c1e32af167b" released by "_delete_snapshot" :: held 4.621s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Lock "cinder-quobyte-ba445564-0deb-4e27-8e88-fd4f5d95f984" released by "delete_snapshot" :: held 4.679s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Flow 'volume_create_manager' (4e73c1d9-eb61-4337-8faa-81496c658825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64758877-13e5-47b7-a943-0ac47b3ecfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64758877-13e5-47b7-a943-0ac47b3ecfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281835337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066b1a27-87da-401f-a235-49ee8e64d288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994b37fb08b6446b8c6c7d40e22b463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:40Z,use_quota=True,user_id='a8e5cadd190e4756a80390477938a926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4c943b-124a-4560-b8dc-4c72a2e353a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4c943b-124a-4560-b8dc-4c72a2e353a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb16529-3425-495e-860c-01f4ae6cf830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb16529-3425-495e-860c-01f4ae6cf830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '066b1a27-87da-401f-a235-49ee8e64d288', 'volume_name': 'volume-066b1a27-87da-401f-a235-49ee8e64d288', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab16af16-888b-49e1-8fed-8f4728ceafd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab16af16-888b-49e1-8fed-8f4728ceafd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f09df2-6858-42fe-b95b-916540f11afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:40 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume 066b1a27-87da-401f-a235-49ee8e64d288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-066b1a27-87da-401f-a235-49ee8e64d288', 'volume_size': 1}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Created reservations ['fa0cb98e-d841-477d-b683-15b483af8fbb', '595cdf73-59d6-4f67-9abc-8d1c370da410', '6c2e73a7-fbc3-4827-b410-5d1bd987ef29', 'e89a6c30-c11b-486c-a10c-0720554a084b'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:40 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Flow 'volume_create_manager' (b3ebe523-e63f-46be-b597-4aa530067863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f798b85-14d2-495a-b252-9c9829bb8073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-208511c4-9ae4-4895-a65b-1b336c8995c4 1073741824" returned: 0 in 1.791s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f798b85-14d2-495a-b252-9c9829bb8073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-725570312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8559cdf2-3ecf-4fcb-bebc-65b5d40207a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994b37fb08b6446b8c6c7d40e22b463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:40Z,use_quota=True,user_id='a8e5cadd190e4756a80390477938a926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629e4456-4089-402c-8bb3-0a854504ca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629e4456-4089-402c-8bb3-0a854504ca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4551dc00-5af2-400e-9b35-d611128f37d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4551dc00-5af2-400e-9b35-d611128f37d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8559cdf2-3ecf-4fcb-bebc-65b5d40207a1', 'volume_name': 'volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043cd503-d20d-4254-a17c-c1ca7d54f024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043cd503-d20d-4254-a17c-c1ca7d54f024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c89aeb-3667-4f68-95e6-444cf64b0c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:40 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume 8559cdf2-3ecf-4fcb-bebc-65b5d40207a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1', 'volume_size': 1}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:40 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Delete snapshot completed successfully.
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-50809c52-3408-40a5-92b0-212999e98897 tempest-CinderUnicodeTest-1404994684 None] Lock "cinder-d8931153-dc64-44ed-8698-4c1e32af167b-delete_snapshot" released by "delete_snapshot" :: held 5.523s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-208511c4-9ae4-4895-a65b-1b336c8995c4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:40 devstack sudo[87743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-208511c4-9ae4-4895-a65b-1b336c8995c4
Apr 24 19:59:40 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Acquiring lock "cinder-ba445564-0deb-4e27-8e88-fd4f5d95f984-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Lock "cinder-ba445564-0deb-4e27-8e88-fd4f5d95f984-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Acquiring lock "cinder-quobyte-ba445564-0deb-4e27-8e88-fd4f5d95f984" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Lock "cinder-quobyte-ba445564-0deb-4e27-8e88-fd4f5d95f984" acquired by "delete_volume" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8585d64-66a3-42c1-bba5-9a9c2538b571]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:41 devstack sudo[87745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984
Apr 24 19:59:41 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:41 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-208511c4-9ae4-4895-a65b-1b336c8995c4" returned: 0 in 0.743s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] <== create_volume: return (2630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.633s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.172s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000005338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994b37fb08b6446b8c6c7d40e22b463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:39Z,use_quota=True,user_id='a8e5cadd190e4756a80390477938a926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Creating volume ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:59:41 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a498c6a-3c5d-4fb7-b031-73c3402a8902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208511c4-9ae4-4895-a65b-1b336c8995c4', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359fc3d5-7779-4793-9928-c2bf1ebd593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:41 devstack sudo[87760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8 1073741824
Apr 24 19:59:41 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume volume-208511c4-9ae4-4895-a65b-1b336c8995c4 (208511c4-9ae4-4895-a65b-1b336c8995c4): created successfully
Apr 24 19:59:41 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359fc3d5-7779-4793-9928-c2bf1ebd593a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Flow 'volume_create_manager' (970d43e5-66dc-4761-a07b-d973d5b17c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:41 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-981c5f4f-2172-40eb-b19c-e4f6bed94acd tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Created volume successfully.
Apr 24 19:59:41 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984" returned: 0 in 0.929s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:41 devstack sudo[87780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984
Apr 24 19:59:41 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:42 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8 1073741824" returned: 0 in 0.884s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:42 devstack sudo[87786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8
Apr 24 19:59:42 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:42 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba445564-0deb-4e27-8e88-fd4f5d95f984" returned: 0 in 0.627s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Lock "cinder-quobyte-ba445564-0deb-4e27-8e88-fd4f5d95f984" released by "delete_volume" :: held 1.615s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Created reservations ['0981e8ab-3cc5-4209-b910-2e130dd735fd', '2be4cff7-303c-4d56-8c36-c9786d201110', '3aa37e4d-f044-466c-a2c3-2ef341b2d2b2', '94dd6591-709b-49e3-b787-e161b1abbe07'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:42 devstack sudo[87790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:42 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:42 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8" returned: 0 in 0.570s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.181s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-179614298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660e863a-f607-4ee8-b38e-a04e59688268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994b37fb08b6446b8c6c7d40e22b463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:40Z,use_quota=True,user_id='a8e5cadd190e4756a80390477938a926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Creating volume 660e863a-f607-4ee8-b38e-a04e59688268 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:59:42 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:59:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-660e863a-f607-4ee8-b38e-a04e59688268 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd291a4-23ca-4b66-b8df-7d537e5ab9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954d0ade-a52c-4de9-b049-b6ae7a1c5cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:43 devstack sudo[87793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-660e863a-f607-4ee8-b38e-a04e59688268 1073741824
Apr 24 19:59:43 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:43 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8 (ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8): created successfully
Apr 24 19:59:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954d0ade-a52c-4de9-b049-b6ae7a1c5cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Flow 'volume_create_manager' (ca1a28e8-35ea-43e0-bfcd-98dd03f7c7a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:43 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-5c6c48b5-2bc8-49a8-9be3-c817acc9d214 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Created volume successfully.
Apr 24 19:59:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Acquiring lock "cinder-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Lock "cinder-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Acquiring lock "cinder-quobyte-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Lock "cinder-quobyte-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d" acquired by "delete_volume" :: waited 0.043s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:43 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35b7eab-dcdd-44f5-9a76-819ab9526753]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:43 devstack sudo[87795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d
Apr 24 19:59:43 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:43 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.840s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:43 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:43 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Deleted volume successfully.
Apr 24 19:59:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad2959c6-3300-4303-ab20-65302bd5cbfd tempest-CinderUnicodeTest-1404994684 None] Lock "cinder-ba445564-0deb-4e27-8e88-fd4f5d95f984-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:44 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d" returned: 0 in 0.698s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:44 devstack sudo[87806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d
Apr 24 19:59:44 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:44 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-660e863a-f607-4ee8-b38e-a04e59688268 1073741824" returned: 0 in 1.052s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:UPDATE=162,cinder:SELECT=142,cinder:INSERT=51,cinder:DELETE=10 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-660e863a-f607-4ee8-b38e-a04e59688268 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:44 devstack sudo[87808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-660e863a-f607-4ee8-b38e-a04e59688268
Apr 24 19:59:44 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:44 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d" returned: 0 in 0.516s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Lock "cinder-quobyte-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d" released by "delete_volume" :: held 1.253s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=128,cinder:UPDATE=185,cinder:DELETE=21,cinder:INSERT=33 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Created reservations ['b8dfa7a3-420e-4614-b60c-21da1661db6e', '7b6326fd-c671-43c9-9145-b81362411971', '02bc2cb3-7a2c-4497-95a8-40a0cf9109e2', 'ba180ca3-545e-418d-ab53-e303da67b052'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:44 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-660e863a-f607-4ee8-b38e-a04e59688268" returned: 0 in 0.618s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.316s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281835337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066b1a27-87da-401f-a235-49ee8e64d288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994b37fb08b6446b8c6c7d40e22b463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:40Z,use_quota=True,user_id='a8e5cadd190e4756a80390477938a926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Creating volume 066b1a27-87da-401f-a235-49ee8e64d288 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:59:44 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-066b1a27-87da-401f-a235-49ee8e64d288 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:44 devstack sudo[87812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-066b1a27-87da-401f-a235-49ee8e64d288 1073741824
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:44 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e10bb3-26d3-4a0d-87e5-06f8338d0c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660e863a-f607-4ee8-b38e-a04e59688268', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:44 devstack sudo[87814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885e30c1-9677-4b05-809c-2e67661e0549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:44 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:44 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume volume-660e863a-f607-4ee8-b38e-a04e59688268 (660e863a-f607-4ee8-b38e-a04e59688268): created successfully
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885e30c1-9677-4b05-809c-2e67661e0549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Flow 'volume_create_manager' (7bd1d6ef-2311-4e2f-9ae9-90230b879004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:44 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a09390c0-4488-4b7d-a85d-f706a9641bd5 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Created volume successfully.
Apr 24 19:59:45 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.617s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:45 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:45 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Deleted volume successfully.
Apr 24 19:59:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9edd2975-765c-43db-b556-5f33f3661bca tempest-CinderUnicodeTest-1404994684 None] Lock "cinder-ba9e4081-6e99-4d5d-bffc-3e00505d2b1d-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:45 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-066b1a27-87da-401f-a235-49ee8e64d288 1073741824" returned: 0 in 0.861s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-066b1a27-87da-401f-a235-49ee8e64d288 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:45 devstack sudo[87820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-066b1a27-87da-401f-a235-49ee8e64d288
Apr 24 19:59:45 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:46 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-066b1a27-87da-401f-a235-49ee8e64d288" returned: 0 in 0.546s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.521s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-725570312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8559cdf2-3ecf-4fcb-bebc-65b5d40207a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='994b37fb08b6446b8c6c7d40e22b463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:40Z,use_quota=True,user_id='a8e5cadd190e4756a80390477938a926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Creating volume 8559cdf2-3ecf-4fcb-bebc-65b5d40207a1 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 19:59:46 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f09df2-6858-42fe-b95b-916540f11afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066b1a27-87da-401f-a235-49ee8e64d288', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c24f2b-d375-464c-b67d-dd6b5788fa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:46 devstack sudo[87823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1 1073741824
Apr 24 19:59:46 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:46 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume volume-066b1a27-87da-401f-a235-49ee8e64d288 (066b1a27-87da-401f-a235-49ee8e64d288): created successfully
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c24f2b-d375-464c-b67d-dd6b5788fa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Flow 'volume_create_manager' (4e73c1d9-eb61-4337-8faa-81496c658825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:46 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-87df1f62-89cd-4142-a96f-61e2884a37c9 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Created volume successfully.
Apr 24 19:59:47 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1 1073741824" returned: 0 in 1.090s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:47 devstack sudo[87829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1
Apr 24 19:59:47 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:48 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1" returned: 0 in 0.645s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c89aeb-3667-4f68-95e6-444cf64b0c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefc41ea-1449-4b1c-b2d6-6d43693197cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:48 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Volume volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1 (8559cdf2-3ecf-4fcb-bebc-65b5d40207a1): created successfully
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefc41ea-1449-4b1c-b2d6-6d43693197cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Flow 'volume_create_manager' (b3ebe523-e63f-46be-b597-4aa530067863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:48 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b2cc069f-871f-48a6-801d-8b4e5b0bc79f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Created volume successfully.
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "cinder-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "cinder-quobyte-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-quobyte-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c840011-3fae-4040-9418-9fa299570e4c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:48 devstack sudo[87832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1
Apr 24 19:59:48 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[49601761-e216-4b09-89ae-dc447b4f3067]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:49 devstack sudo[87834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b
Apr 24 19:59:49 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:49 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1" returned: 0 in 0.656s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:49 devstack sudo[87840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1
Apr 24 19:59:49 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:49 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" returned: 0 in 0.616s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:49 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b17fa46-938b-4f9c-8c46-b002ac75bd10]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:49 devstack sudo[87845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b
Apr 24 19:59:49 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:49 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1" returned: 0 in 0.562s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-quobyte-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1" released by "delete_volume" :: held 1.264s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:49 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Created reservations ['d88f145b-4f62-4d93-8d4c-25dedee8bcb8', '9adca168-e4d6-456c-bd86-f279883b4a66', 'dd04020d-8020-4637-85e0-0bcddcecd860', '93bd166c-3b61-4c00-9e8c-6c658304533f'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:50 devstack sudo[87850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:50 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 19:59:50 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Flow 'volume_create_manager' (5b69dde0-2e61-4d8c-925a-c0f8042f8353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa7cddc-26d1-4bec-986c-2f6ec3acbbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" returned: 0 in 0.649s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.1bb1b19c-3074-4589-b4fe-205d5ee6b2c3lq83jhuw.img {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa7cddc-26d1-4bec-986c-2f6ec3acbbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-952801069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d626482-b2e2-48e6-8551-6ce86d51c7af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ece5b69aa96d4924b2099689562776c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:50Z,use_quota=True,user_id='7c117004725b40849974790b6c4e72a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:50 devstack sudo[87853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.1bb1b19c-3074-4589-b4fe-205d5ee6b2c3lq83jhuw.img
Apr 24 19:59:50 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b665853d-3012-4cbe-9471-73c30b13b143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b665853d-3012-4cbe-9471-73c30b13b143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68be485b-f99d-4b06-9021-f5f240105c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68be485b-f99d-4b06-9021-f5f240105c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d626482-b2e2-48e6-8551-6ce86d51c7af', 'volume_name': 'volume-9d626482-b2e2-48e6-8551-6ce86d51c7af', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888fcc5d-e0ee-49a6-a55f-049a3436bf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888fcc5d-e0ee-49a6-a55f-049a3436bf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73c94e7-ca7f-458b-ba5e-57230bae5703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 19:59:50 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Volume 9d626482-b2e2-48e6-8551-6ce86d51c7af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d626482-b2e2-48e6-8551-6ce86d51c7af', 'volume_size': 1}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:50 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.504s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:50 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Deleted volume successfully.
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d7996856-caa5-4444-8703-22d52fbe15fb tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-8559cdf2-3ecf-4fcb-bebc-65b5d40207a1-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "cinder-066b1a27-87da-401f-a235-49ee8e64d288-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-066b1a27-87da-401f-a235-49ee8e64d288-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:50 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "cinder-quobyte-066b1a27-87da-401f-a235-49ee8e64d288" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:51 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-quobyte-066b1a27-87da-401f-a235-49ee8e64d288" acquired by "delete_volume" :: waited 0.025s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:51 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c629da7-e76a-467f-b74e-6f848f6e8793]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-066b1a27-87da-401f-a235-49ee8e64d288 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:51 devstack sudo[87867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-066b1a27-87da-401f-a235-49ee8e64d288
Apr 24 19:59:51 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:51 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-066b1a27-87da-401f-a235-49ee8e64d288" returned: 0 in 0.881s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-066b1a27-87da-401f-a235-49ee8e64d288 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:52 devstack sudo[87872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-066b1a27-87da-401f-a235-49ee8e64d288
Apr 24 19:59:52 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:52 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-066b1a27-87da-401f-a235-49ee8e64d288" returned: 0 in 0.647s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-quobyte-066b1a27-87da-401f-a235-49ee8e64d288" released by "delete_volume" :: held 1.656s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:52 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Created reservations ['6d136fcb-091d-4a48-a2eb-271efc7d6d42', '85d27e74-7e8b-4594-bc37-336aa09232dd', 'a4bfe838-e581-4bc1-9e7d-d35a87b516a0', '9c767537-eb6f-4c8b-86fd-9416f80a87ef'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:52 devstack sudo[87875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:52 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "cinder-660e863a-f607-4ee8-b38e-a04e59688268-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-660e863a-f607-4ee8-b38e-a04e59688268-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "cinder-quobyte-660e863a-f607-4ee8-b38e-a04e59688268" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-quobyte-660e863a-f607-4ee8-b38e-a04e59688268" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:53 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dcad10-1e55-4cc5-92e9-983a8e135f6b]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-660e863a-f607-4ee8-b38e-a04e59688268 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:53 devstack sudo[87877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-660e863a-f607-4ee8-b38e-a04e59688268
Apr 24 19:59:53 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:54 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.222s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:54 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:54 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Deleted volume successfully.
Apr 24 19:59:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e079af92-67e9-4b1e-ba26-9176e5ab41af tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-066b1a27-87da-401f-a235-49ee8e64d288-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:54 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-660e863a-f607-4ee8-b38e-a04e59688268" returned: 0 in 1.366s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-660e863a-f607-4ee8-b38e-a04e59688268 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:55 devstack sudo[87883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-660e863a-f607-4ee8-b38e-a04e59688268
Apr 24 19:59:55 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:55 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.1bb1b19c-3074-4589-b4fe-205d5ee6b2c3lq83jhuw.img" returned: 0 in 5.077s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1333079-bab5-4784-8ab2-74d0e2b4a026]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:55 devstack sudo[87885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b
Apr 24 19:59:55 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:55 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-660e863a-f607-4ee8-b38e-a04e59688268" returned: 0 in 0.581s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-quobyte-660e863a-f607-4ee8-b38e-a04e59688268" released by "delete_volume" :: held 2.019s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Created reservations ['313a24e9-c65a-4bfe-9224-129893ee5f12', '3503e23c-731d-40ec-a70f-b5ca26f26775', '18081e40-f78a-4744-974d-d2777e7315ba', 'e44986ab-8ea4-4f57-afc2-8e8c88ec439b'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:55 devstack sudo[87890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:55 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "cinder-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "cinder-quobyte-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-quobyte-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8" acquired by "delete_volume" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[09559a4b-53cc-4ede-b866-c1862bd4bc60]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:55 devstack sudo[87892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8
Apr 24 19:59:55 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" returned: 0 in 0.735s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:56 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b, size 1024.00 MB, duration 5.08 sec, destination /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.1bb1b19c-3074-4589-b4fe-205d5ee6b2c3lq83jhuw.img {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 19:59:56 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] Converted 1024.00 MB image at 201.64 MB/s
Apr 24 19:59:56 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:56 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] 1bb1b19c-3074-4589-b4fe-205d5ee6b2c3 was raw, no need to convert to raw {{(pid=81241) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 24 19:59:56 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.575s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:56 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:56 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Deleted volume successfully.
Apr 24 19:59:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ad3c53c9-5c21-4818-b913-eb728bb72edc tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-660e863a-f607-4ee8-b38e-a04e59688268-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:56 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8" returned: 0 in 0.597s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:56 devstack sudo[87899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8
Apr 24 19:59:56 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:56 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8" returned: 0 in 0.481s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-quobyte-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8" released by "delete_volume" :: held 1.119s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:57 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Created reservations ['70ae7844-b432-4681-851a-add3255e0708', '7722f3d6-d302-4d88-adb1-b72e65f03010', '04403c92-a9a7-4dba-9637-3b64b7919cc1', 'a5c3db45-1426-48ef-877d-5226bfe7f29d'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:57 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:57 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:57 devstack sudo[87902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:57 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:57 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.524s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:57 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 19:59:57 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Deleted volume successfully.
Apr 24 19:59:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-455b7179-b9c3-44c1-aa41-a0e785fe9cee tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-ad1be6cb-0cb2-46d0-b099-1a1f5cb17be8-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "cinder-208511c4-9ae4-4895-a65b-1b336c8995c4-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-208511c4-9ae4-4895-a65b-1b336c8995c4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "cinder-quobyte-208511c4-9ae4-4895-a65b-1b336c8995c4" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 19:59:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-quobyte-208511c4-9ae4-4895-a65b-1b336c8995c4" acquired by "delete_volume" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 19:59:58 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae25efb-49b6-4002-ba91-162bb37da734]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 19:59:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-208511c4-9ae4-4895-a65b-1b336c8995c4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:58 devstack sudo[87905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-208511c4-9ae4-4895-a65b-1b336c8995c4
Apr 24 19:59:58 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:58 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-208511c4-9ae4-4895-a65b-1b336c8995c4" returned: 0 in 0.584s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-208511c4-9ae4-4895-a65b-1b336c8995c4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:58 devstack sudo[87910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-208511c4-9ae4-4895-a65b-1b336c8995c4
Apr 24 19:59:58 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 19:59:59 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root
Apr 24 19:59:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-208511c4-9ae4-4895-a65b-1b336c8995c4" returned: 0 in 0.593s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 19:59:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-quobyte-208511c4-9ae4-4895-a65b-1b336c8995c4" released by "delete_volume" :: held 1.228s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 19:59:59 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Created reservations ['c6c2543a-7cf4-4db7-a7ac-9e7b3fbfaa24', '3260e782-94d9-4ded-a477-c9d7e8e9dfb8', '9517f824-b3d3-446a-9899-5ad155db69cc', '050f24df-23fb-4aaa-96f4-0b0b811a96a3'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 19:59:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 19:59:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 19:59:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 19:59:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 19:59:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 19:59:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 19:59:59 devstack sudo[87914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 19:59:59 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:00 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.507s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:00 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:00:00 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Deleted volume successfully.
Apr 24 20:00:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d1a586da-44e6-4f3c-b70d-1f0e2830177f tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-208511c4-9ae4-4895-a65b-1b336c8995c4-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "cinder-d5898cfc-8641-4961-8270-7d75ae86ba15-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-d5898cfc-8641-4961-8270-7d75ae86ba15-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "cinder-quobyte-d5898cfc-8641-4961-8270-7d75ae86ba15" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-quobyte-d5898cfc-8641-4961-8270-7d75ae86ba15" acquired by "delete_volume" :: waited 0.026s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:00 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df13640-4711-45f0-a74d-c08484bad11e]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d5898cfc-8641-4961-8270-7d75ae86ba15 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:00 devstack sudo[87917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d5898cfc-8641-4961-8270-7d75ae86ba15
Apr 24 20:00:00 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:01 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d5898cfc-8641-4961-8270-7d75ae86ba15" returned: 0 in 0.608s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d5898cfc-8641-4961-8270-7d75ae86ba15 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:01 devstack sudo[87922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d5898cfc-8641-4961-8270-7d75ae86ba15
Apr 24 20:00:01 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:01 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d5898cfc-8641-4961-8270-7d75ae86ba15" returned: 0 in 0.526s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:01 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-quobyte-d5898cfc-8641-4961-8270-7d75ae86ba15" released by "delete_volume" :: held 1.211s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:01 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Created reservations ['3f453e5e-c6b0-47a1-b8ee-426ddce4997b', '9e92498f-ed69-4ab9-b259-51646f7db521', '4d52d5af-fb26-4d18-8938-a36a5c489e04', '9bdcd889-3d48-4360-a84a-7fbe12b5142e'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:00:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:01 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:01 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:01 devstack sudo[87925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:00:01 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:02 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.475s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:02 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:00:02 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Deleted volume successfully.
Apr 24 20:00:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9abdc356-05c2-4c80-91d8-c43b36fc1f45 tempest-CreateVolumesFromSourceVolumeTest-506900398 None] Lock "cinder-d5898cfc-8641-4961-8270-7d75ae86ba15-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.193s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:12 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] Uploaded volume to glance image-id: 1bb1b19c-3074-4589-b4fe-205d5ee6b2c3. {{(pid=81241) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 24 20:00:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.843s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T17:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-952801069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d626482-b2e2-48e6-8551-6ce86d51c7af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ece5b69aa96d4924b2099689562776c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:50Z,use_quota=True,user_id='7c117004725b40849974790b6c4e72a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:00:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Creating volume 9d626482-b2e2-48e6-8551-6ce86d51c7af {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:00:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:00:12 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:00:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9d626482-b2e2-48e6-8551-6ce86d51c7af 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:12 devstack sudo[87931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9d626482-b2e2-48e6-8551-6ce86d51c7af 1073741824
Apr 24 20:00:12 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:12 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-09d31bfb-8e98-48f0-8b6a-5ec433b306cf tempest-VolumesActionsTest-1357342770 None] Copy volume to image completed successfully.
Apr 24 20:00:12 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9d626482-b2e2-48e6-8551-6ce86d51c7af 1073741824" returned: 0 in 0.604s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9d626482-b2e2-48e6-8551-6ce86d51c7af {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:12 devstack sudo[87936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9d626482-b2e2-48e6-8551-6ce86d51c7af
Apr 24 20:00:12 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:13 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9d626482-b2e2-48e6-8551-6ce86d51c7af" returned: 0 in 0.448s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:00:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73c94e7-ca7f-458b-ba5e-57230bae5703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d626482-b2e2-48e6-8551-6ce86d51c7af', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4396a988-6e39-4cfe-97a2-a4db38122be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:13 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Volume volume-9d626482-b2e2-48e6-8551-6ce86d51c7af (9d626482-b2e2-48e6-8551-6ce86d51c7af): created successfully
Apr 24 20:00:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4396a988-6e39-4cfe-97a2-a4db38122be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Flow 'volume_create_manager' (5b69dde0-2e61-4d8c-925a-c0f8042f8353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:00:13 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-7dd53804-f274-47c9-8df4-b3ccfbffb9bd tempest-VolumesTestJSON-540670880 None] Created volume successfully.
Apr 24 20:00:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:13 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ecdfb0-0d5c-47fd-bbf1-0c01c0b3ca40]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:13 devstack sudo[87939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b
Apr 24 20:00:13 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Flow 'volume_create_manager' (62d7fe15-0914-4eca-88f9-64bfe3b7e7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705f0cee-7ba6-4b01-8c25-561a5d1bd9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:14 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" returned: 0 in 0.577s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c0b6c9-c545-49a1-8a7b-2625a25d78bf]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705f0cee-7ba6-4b01-8c25-561a5d1bd9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1200420299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7de17e-6e4d-4422-a6b5-add4e782ff28,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ece5b69aa96d4924b2099689562776c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:14Z,use_quota=True,user_id='7c117004725b40849974790b6c4e72a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c67d6c7-96db-40ce-9652-a9e155bb3a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c67d6c7-96db-40ce-9652-a9e155bb3a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b05b1a2-3992-449e-b94c-2f2aca996b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b05b1a2-3992-449e-b94c-2f2aca996b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b7de17e-6e4d-4422-a6b5-add4e782ff28', 'volume_name': 'volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2327de10-a971-4184-b1f3-d06b9ccaeebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2327de10-a971-4184-b1f3-d06b9ccaeebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a4fb0b-d8b4-4351-860a-575d49ee72aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:14 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Volume 2b7de17e-6e4d-4422-a6b5-add4e782ff28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28', 'volume_size': 1}
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:14 devstack sudo[87944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b
Apr 24 20:00:14 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:14 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" returned: 0 in 0.545s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:14 devstack sudo[87949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img
Apr 24 20:00:14 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:19 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img" returned: 0 in 4.504s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:19 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9a85b5-a49c-44e3-b509-97a00ca26c80]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:19 devstack sudo[87969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b
Apr 24 20:00:19 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:20 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" returned: 0 in 0.683s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:20 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 20:00:20 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Converted 1024.00 MB image at 227.32 MB/s
Apr 24 20:00:20 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] b7f554e3-d425-4028-8966-7b86dcbc16db was raw, converting to qcow2 {{(pid=81241) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 24 20:00:20 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f40321-d993-4ed0-99a7-4c24a045c68e]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:20 devstack sudo[87974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img
Apr 24 20:00:20 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:20 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img" returned: 0 in 0.476s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:20 devstack sudo[87978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img
Apr 24 20:00:20 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:21 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img" returned: 1 in 0.476s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 20:00:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img /opt/stack/data/cinder/conversion/vol_upload_iokspdmc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:21 devstack sudo[87983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img /opt/stack/data/cinder/conversion/vol_upload_iokspdmc
Apr 24 20:00:21 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:21 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img /opt/stack/data/cinder/conversion/vol_upload_iokspdmc" returned: 0 in 0.481s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:21 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Image conversion details: src /opt/stack/data/cinder/conversion/cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b.temp_image.b7f554e3-d425-4028-8966-7b86dcbc16dblgr1llqs.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_iokspdmc {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 20:00:21 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 24 20:00:21 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc67868-16d1-40d2-99ec-9e8ad884c3a1]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_iokspdmc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:21 devstack sudo[87988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_iokspdmc
Apr 24 20:00:21 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:21 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_iokspdmc" returned: 0 in 0.466s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.645s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Uploaded volume to glance image-id: b7f554e3-d425-4028-8966-7b86dcbc16db. {{(pid=81241) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.983s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1200420299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7de17e-6e4d-4422-a6b5-add4e782ff28,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ece5b69aa96d4924b2099689562776c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:14Z,use_quota=True,user_id='7c117004725b40849974790b6c4e72a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Creating volume 2b7de17e-6e4d-4422-a6b5-add4e782ff28 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:00:23 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:23 devstack sudo[87995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28 1073741824
Apr 24 20:00:23 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:23 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e1e15efa-3f8d-485d-8633-9f18642bb516 tempest-VolumesActionsTest-1357342770 None] Copy volume to image completed successfully.
Apr 24 20:00:23 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28 1073741824" returned: 0 in 0.596s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:24 devstack sudo[88000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:00:24 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:24 devstack sudo[88001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28
Apr 24 20:00:24 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:24 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28" returned: 0 in 0.486s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a4fb0b-d8b4-4351-860a-575d49ee72aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d0b31f-1f63-4be0-a0dd-416c44be30dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:24 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.553s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:00:24 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Volume volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28 (2b7de17e-6e4d-4422-a6b5-add4e782ff28): created successfully
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d0b31f-1f63-4be0-a0dd-416c44be30dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Flow 'volume_create_manager' (62d7fe15-0914-4eca-88f9-64bfe3b7e7e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:00:24 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-2273e2cb-b8c1-43c2-8e6f-bdf03f83310d tempest-VolumesTestJSON-540670880 None] Created volume successfully.
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Acquiring lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Acquiring lock "cinder-quobyte-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Lock "cinder-quobyte-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" acquired by "delete_volume" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7859250a-b962-42c0-8dd8-80f55325469e]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:24 devstack sudo[88006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b
Apr 24 20:00:24 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:25 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" returned: 0 in 0.564s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:25 devstack sudo[88011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b
Apr 24 20:00:25 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Flow 'volume_create_manager' (19810e22-dc77-41f4-9159-eff7b78cbfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4462562-8f66-46e2-81f8-4fbdfd9b23f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4462562-8f66-46e2-81f8-4fbdfd9b23f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1595912032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c23b18-ab2d-4f47-b8b8-04257b20e08a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ece5b69aa96d4924b2099689562776c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:26Z,use_quota=True,user_id='7c117004725b40849974790b6c4e72a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19214c48-fea1-480f-8f2b-20d6c05cc45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19214c48-fea1-480f-8f2b-20d6c05cc45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f43fb7-d245-47c5-b5f6-f690ba193ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f43fb7-d245-47c5-b5f6-f690ba193ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c23b18-ab2d-4f47-b8b8-04257b20e08a', 'volume_name': 'volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83cbcdf9-3ac9-4ccb-abfb-714f4bc7c957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83cbcdf9-3ac9-4ccb-abfb-714f4bc7c957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdccc987-ed1a-4df0-ae7e-6c338c3cd72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:25 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Volume d0c23b18-ab2d-4f47-b8b8-04257b20e08a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a', 'volume_size': 1}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1595912032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c23b18-ab2d-4f47-b8b8-04257b20e08a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ece5b69aa96d4924b2099689562776c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:26Z,use_quota=True,user_id='7c117004725b40849974790b6c4e72a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Creating volume d0c23b18-ab2d-4f47-b8b8-04257b20e08a {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:00:25 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:25 devstack sudo[88013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a 1073741824
Apr 24 20:00:25 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:25 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" returned: 0 in 0.540s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Lock "cinder-quobyte-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b" released by "delete_volume" :: held 1.145s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Created reservations ['6fc0c8ff-7908-4d0e-a1b4-598ee1b9bf1c', 'd8f9044d-1680-4728-8b11-d3f825084cb6', '262c47d5-908a-4c73-93cd-c01dfe0a9273', '4f2d5a5e-fcaf-4782-8663-4db8258da228'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:26 devstack sudo[88016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:00:26 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:26 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a 1073741824" returned: 0 in 0.656s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:26 devstack sudo[88021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a
Apr 24 20:00:26 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:26 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.471s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:00:26 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Deleted volume successfully.
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a93b1e7b-6dd2-4498-9fa3-58433169247e tempest-VolumesActionsTest-1357342770 None] Lock "cinder-cc83cdd6-5574-46c9-8aa0-de4ab84b1f1b-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:26 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a" returned: 0 in 0.440s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdccc987-ed1a-4df0-ae7e-6c338c3cd72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87efe4ac-ad38-4201-ac6f-395dd060bfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:26 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Volume volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a (d0c23b18-ab2d-4f47-b8b8-04257b20e08a): created successfully
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87efe4ac-ad38-4201-ac6f-395dd060bfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Flow 'volume_create_manager' (19810e22-dc77-41f4-9159-eff7b78cbfe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:00:26 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-683055b4-b769-401b-83db-b6837e14d032 tempest-VolumesTestJSON-540670880 None] Created volume successfully.
Apr 24 20:00:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Acquiring lock "cinder-d0c23b18-ab2d-4f47-b8b8-04257b20e08a-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Lock "cinder-d0c23b18-ab2d-4f47-b8b8-04257b20e08a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Acquiring lock "cinder-quobyte-d0c23b18-ab2d-4f47-b8b8-04257b20e08a" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Lock "cinder-quobyte-d0c23b18-ab2d-4f47-b8b8-04257b20e08a" acquired by "delete_volume" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:28 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b4b961-3b44-4a6d-97d1-086472e9ea84]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:28 devstack sudo[88027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a
Apr 24 20:00:28 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:29 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a" returned: 0 in 0.589s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:29 devstack sudo[88033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a
Apr 24 20:00:29 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:29 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d0c23b18-ab2d-4f47-b8b8-04257b20e08a" returned: 0 in 0.508s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Lock "cinder-quobyte-d0c23b18-ab2d-4f47-b8b8-04257b20e08a" released by "delete_volume" :: held 1.142s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:29 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Created reservations ['2a5c5245-3257-48ae-b5b8-99d588f201ff', '03ffa82b-7a37-4cfd-a25f-b98745b3852e', '05eae62a-f2b7-40ab-ad59-2bf26a5bb3d2', 'd9dd78fd-9c03-465e-85ee-1904690c596e'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:00:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:29 devstack sudo[88037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:00:29 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:30 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.522s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:30 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:00:30 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Deleted volume successfully.
Apr 24 20:00:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c16d776c-7d16-4081-82ba-b85fd780266b tempest-VolumesTestJSON-540670880 None] Lock "cinder-d0c23b18-ab2d-4f47-b8b8-04257b20e08a-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Acquiring lock "cinder-2b7de17e-6e4d-4422-a6b5-add4e782ff28-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Lock "cinder-2b7de17e-6e4d-4422-a6b5-add4e782ff28-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Acquiring lock "cinder-quobyte-2b7de17e-6e4d-4422-a6b5-add4e782ff28" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Lock "cinder-quobyte-2b7de17e-6e4d-4422-a6b5-add4e782ff28" acquired by "delete_volume" :: waited 0.021s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:30 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3994604d-368e-419d-a6fc-da3dd358bfae]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:31 devstack sudo[88041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28
Apr 24 20:00:31 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:31 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28" returned: 0 in 0.614s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:31 devstack sudo[88046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28
Apr 24 20:00:31 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:32 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2b7de17e-6e4d-4422-a6b5-add4e782ff28" returned: 0 in 0.486s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Lock "cinder-quobyte-2b7de17e-6e4d-4422-a6b5-add4e782ff28" released by "delete_volume" :: held 1.142s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Created reservations ['6c5ff6ba-7aa5-48f2-b666-317a48ca5515', '85f93cae-f50d-40f9-bd63-fff796114ca2', 'bfe1dd2c-cf48-4680-b613-4fffef66337f', '9741733b-6359-42df-811e-a9ad0bc2cf6f'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:32 devstack sudo[88049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:00:32 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Flow 'volume_create_manager' (0233c13c-ad89-4d3e-ae09-3ad650b7151a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddfc37b-8b79-4728-93b3-8861cd643663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddfc37b-8b79-4728-93b3-8861cd643663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-671364305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1f24af-0758-423f-957a-ad34c3fb39c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44ab10fbc364eb49777cdf1972e5136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:33Z,use_quota=True,user_id='cd304f3f186c4141aea9dad8e83c32df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b879f6b-03d2-42ac-ae4c-a10939ac65f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b879f6b-03d2-42ac-ae4c-a10939ac65f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08f515c-6b68-411c-a042-b96acb54a0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.image.glance [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Creating Keystone auth plugin from conf {{(pid=81241) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 24 20:00:32 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.508s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:00:32 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Deleted volume successfully.
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a8c9e0a6-8566-4a52-bc6e-4726471a8641 tempest-VolumesTestJSON-540670880 None] Lock "cinder-2b7de17e-6e4d-4422-a6b5-add4e782ff28-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08f515c-6b68-411c-a042-b96acb54a0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d1f24af-0758-423f-957a-ad34c3fb39c7', 'volume_name': 'volume-4d1f24af-0758-423f-957a-ad34c3fb39c7', 'volume_size': 1, 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b862a13976c94661b0ca990e233a527c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'created_at': datetime.datetime(2026, 4, 24, 17, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 48, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f02e75fc160>}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db5d7bb-45a2-4839-bba5-b646e9e47ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db5d7bb-45a2-4839-bba5-b646e9e47ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf86739d-a24d-4fff-8210-a1276aff9ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:32 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Volume 4d1f24af-0758-423f-957a-ad34c3fb39c7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d1f24af-0758-423f-957a-ad34c3fb39c7', 'volume_size': 1, 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b862a13976c94661b0ca990e233a527c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'created_at': datetime.datetime(2026, 4, 24, 17, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 48, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f02e75fc160>}
Apr 24 20:00:32 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Trying to clone 4d1f24af-0758-423f-957a-ad34c3fb39c7 from image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]). {{(pid=81241) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Acquiring lock "cinder-9d626482-b2e2-48e6-8551-6ce86d51c7af-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Lock "cinder-9d626482-b2e2-48e6-8551-6ce86d51c7af-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Acquiring lock "cinder-quobyte-9d626482-b2e2-48e6-8551-6ce86d51c7af" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7pwz4wxrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81241) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 24 20:00:33 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Image download 20.69 MB at 20.69 MB/s
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Lock "cinder-quobyte-9d626482-b2e2-48e6-8551-6ce86d51c7af" acquired by "delete_volume" :: waited 0.033s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0926b489-6dcc-4341-b908-5d051d29f38c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9d626482-b2e2-48e6-8551-6ce86d51c7af {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a0016c-d432-4f56-8bc7-c293a04014cc]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7pwz4wxrdevstack@QuobyteHD {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:33 devstack sudo[88053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9d626482-b2e2-48e6-8551-6ce86d51c7af
Apr 24 20:00:33 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:33 devstack sudo[88054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7pwz4wxrdevstack@QuobyteHD
Apr 24 20:00:33 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:33 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9d626482-b2e2-48e6-8551-6ce86d51c7af" returned: 0 in 0.529s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9d626482-b2e2-48e6-8551-6ce86d51c7af {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:33 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7pwz4wxrdevstack@QuobyteHD" returned: 0 in 0.510s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Temporary image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd is fetched for user cd304f3f186c4141aea9dad8e83c32df. {{(pid=81241) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 24 20:00:33 devstack sudo[88063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9d626482-b2e2-48e6-8551-6ce86d51c7af
Apr 24 20:00:33 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e69bb9-6ea7-43bc-8d3d-b5835243c4f8]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7pwz4wxrdevstack@QuobyteHD {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:33 devstack sudo[88065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7pwz4wxrdevstack@QuobyteHD
Apr 24 20:00:33 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:34 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-9d626482-b2e2-48e6-8551-6ce86d51c7af" returned: 0 in 0.476s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Lock "cinder-quobyte-9d626482-b2e2-48e6-8551-6ce86d51c7af" released by "delete_volume" :: held 1.054s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Created reservations ['843ccb3a-fefe-451d-8304-9be2c71020db', '36cd6af1-86a1-4bed-b1fa-62a869caee0d', 'd0cbe99e-bc94-4591-92aa-075b41456ed0', '65672c26-c467-44c3-8954-cc53f09d077a'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:00:34 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7pwz4wxrdevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-671364305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1f24af-0758-423f-957a-ad34c3fb39c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44ab10fbc364eb49777cdf1972e5136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:33Z,use_quota=True,user_id='cd304f3f186c4141aea9dad8e83c32df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Creating volume 4d1f24af-0758-423f-957a-ad34c3fb39c7 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:00:34 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:34 devstack sudo[88071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 1073741824
Apr 24 20:00:34 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:34 devstack sudo[88072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:00:34 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:34 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.467s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:00:34 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Deleted volume successfully.
Apr 24 20:00:34 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c983b739-b65b-48a8-ab3d-acf1b403494b tempest-VolumesTestJSON-540670880 None] Lock "cinder-9d626482-b2e2-48e6-8551-6ce86d51c7af-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:35 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 1073741824" returned: 0 in 0.602s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:35 devstack sudo[88079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7
Apr 24 20:00:35 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:35 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7" returned: 0 in 0.488s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:00:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:35 devstack cinder-volume[81241]: DEBUG cinder.volume.volume_utils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Attempting download of 8c41cab8-e7de-4393-aaaf-cc39ab149fdd ((None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}])) to volume 4d1f24af-0758-423f-957a-ad34c3fb39c7. {{(pid=81241) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 24 20:00:35 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e269e0-f793-4b42-969e-eadc10f7d9ae]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_dsvdebw1 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:35 devstack sudo[88082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_dsvdebw1
Apr 24 20:00:35 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:36 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_dsvdebw1" returned: 0 in 0.592s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_dsvdebw1 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:36 devstack sudo[88086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_dsvdebw1
Apr 24 20:00:36 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:36 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_dsvdebw1" returned: 1 in 0.550s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_dsvdebw1' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 20:00:36 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf858171-e9f0-4c46-93a9-9e253e9f5de1]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7pwz4wxrdevstack@QuobyteHD {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:36 devstack sudo[88090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7pwz4wxrdevstack@QuobyteHD
Apr 24 20:00:36 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:37 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7pwz4wxrdevstack@QuobyteHD" returned: 0 in 0.527s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:37 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] 8c41cab8-e7de-4393-aaaf-cc39ab149fdd was qcow2, converting to raw {{(pid=81241) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 24 20:00:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7pwz4wxrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:37 devstack sudo[88095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7pwz4wxrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7
Apr 24 20:00:37 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:38 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7pwz4wxrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7" returned: 0 in 1.416s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:38 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c41cab8-e7de-4393-aaaf-cc39ab149fdd_7pwz4wxrdevstack@QuobyteHD, size 112.00 MB, duration 1.42 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 20:00:38 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Converted 112.00 MB image at 79.02 MB/s
Apr 24 20:00:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:38 devstack sudo[88105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 1G
Apr 24 20:00:38 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:38 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b56bf9b4-1422-4b00-a905-eaa886005b6b tempest-GroupSnapshotsTest-600287551 None] Group tempest-GroupSnapshotsTest-Group-486724436: creating
Apr 24 20:00:38 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b56bf9b4-1422-4b00-a905-eaa886005b6b tempest-GroupSnapshotsTest-600287551 None] Group tempest-GroupSnapshotsTest-Group-486724436: created successfully
Apr 24 20:00:38 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b56bf9b4-1422-4b00-a905-eaa886005b6b tempest-GroupSnapshotsTest-600287551 None] Create group completed successfully.
Apr 24 20:00:39 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 1G" returned: 0 in 0.588s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:39 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1643d6-e6f9-444f-b7ff-89deace7149c]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:39 devstack sudo[88111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7
Apr 24 20:00:39 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:39 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7" returned: 0 in 0.517s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:39 devstack sudo[88149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7
Apr 24 20:00:39 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Flow 'volume_create_manager' (93ad7d5c-b756-4b04-a0a8-91d6ebf381eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd735b8-9882-4644-aa4d-8804d98ebbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd735b8-9882-4644-aa4d-8804d98ebbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1350975294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7000541c-fea9-428a-bbe4-7ac6e4020da2,host='devstack@QuobyteHD#QuobyteHD',id=2e753f2b-3234-4482-9e53-66ce2131ac35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dce998047af4877a4651e632d6ddfdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:40Z,use_quota=True,user_id='7a2c9c890c7a40f6b8c51b785c5b52b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ee49807-dd03-4046-991e-4b75721f74f8),volume_type_id=1ee49807-dd03-4046-991e-4b75721f74f8)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82b7bc4-97f8-4bb2-8a53-a61b5f3bbb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82b7bc4-97f8-4bb2-8a53-a61b5f3bbb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9635944e-5e93-4d80-ac7d-7c19fbc3824c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9635944e-5e93-4d80-ac7d-7c19fbc3824c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e753f2b-3234-4482-9e53-66ce2131ac35', 'volume_name': 'volume-2e753f2b-3234-4482-9e53-66ce2131ac35', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42ee5aa-45b3-4d5c-853c-cbb084a119e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42ee5aa-45b3-4d5c-853c-cbb084a119e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa404c0-b852-41e0-ae65-23f122c27315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:40 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Volume 2e753f2b-3234-4482-9e53-66ce2131ac35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e753f2b-3234-4482-9e53-66ce2131ac35', 'volume_size': 1}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7000541c-fea9-428a-bbe4-7ac6e4020da2,created_at=2026-04-24T18:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1350975294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7000541c-fea9-428a-bbe4-7ac6e4020da2,host='devstack@QuobyteHD#QuobyteHD',id=2e753f2b-3234-4482-9e53-66ce2131ac35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dce998047af4877a4651e632d6ddfdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:40Z,use_quota=True,user_id='7a2c9c890c7a40f6b8c51b785c5b52b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ee49807-dd03-4046-991e-4b75721f74f8),volume_type_id=1ee49807-dd03-4046-991e-4b75721f74f8)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Creating volume 2e753f2b-3234-4482-9e53-66ce2131ac35 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:00:40 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:40 devstack sudo[88154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35 1073741824
Apr 24 20:00:40 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:40 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7" returned: 1 in 0.617s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.volume_utils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Downloaded image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd ((None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}])) to volume 4d1f24af-0758-423f-957a-ad34c3fb39c7 successfully. {{(pid=81241) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Temporary image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd for user cd304f3f186c4141aea9dad8e83c32df is deleted. {{(pid=81241) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.volume_utils [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Marking volume 4d1f24af-0758-423f-957a-ad34c3fb39c7 as bootable. {{(pid=81241) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Copying metadata from image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd to 4d1f24af-0758-423f-957a-ad34c3fb39c7. {{(pid=81241) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Creating volume glance metadata for volume 4d1f24af-0758-423f-957a-ad34c3fb39c7 backed by image 8c41cab8-e7de-4393-aaaf-cc39ab149fdd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81241) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf86739d-a24d-4fff-8210-a1276aff9ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d1f24af-0758-423f-957a-ad34c3fb39c7', 'volume_size': 1, 'image_id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b862a13976c94661b0ca990e233a527c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c41cab8-e7de-4393-aaaf-cc39ab149fdd', 'created_at': datetime.datetime(2026, 4, 24, 17, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 48, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c41cab8-e7de-4393-aaaf-cc39ab149fdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f02e75fc160>}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c7ca0d-2eca-4ce2-9c94-fce59fee4046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:40 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Volume volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 (4d1f24af-0758-423f-957a-ad34c3fb39c7): created successfully
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c7ca0d-2eca-4ce2-9c94-fce59fee4046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Flow 'volume_create_manager' (0233c13c-ad89-4d3e-ae09-3ad650b7151a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:00:40 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-9df2c67c-7104-4c80-8549-08db51e65973 tempest-VolumesExtendTest-1780557260 None] Created volume successfully.
Apr 24 20:00:40 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35 1073741824" returned: 0 in 0.593s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:41 devstack sudo[88159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35
Apr 24 20:00:41 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-14576f4a-fcff-4245-9894-da330829f14f tempest-VolumesExtendTest-1780557260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:41 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35" returned: 0 in 0.503s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:00:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-14576f4a-fcff-4245-9894-da330829f14f tempest-VolumesExtendTest-1780557260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.291s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa404c0-b852-41e0-ae65-23f122c27315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e753f2b-3234-4482-9e53-66ce2131ac35', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf7a02c-45b2-4779-abb8-ca5ca2e7397d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:41 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97dab17-65df-4742-a60b-dad9e80a1625]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-14576f4a-fcff-4245-9894-da330829f14f tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:41 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Volume volume-2e753f2b-3234-4482-9e53-66ce2131ac35 (2e753f2b-3234-4482-9e53-66ce2131ac35): created successfully
Apr 24 20:00:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf7a02c-45b2-4779-abb8-ca5ca2e7397d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Flow 'volume_create_manager' (93ad7d5c-b756-4b04-a0a8-91d6ebf381eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:00:41 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-4a5df893-f9f9-4ef1-be57-c20212abec15 tempest-GroupSnapshotsTest-600287551 None] Created volume successfully.
Apr 24 20:00:41 devstack sudo[88162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7
Apr 24 20:00:41 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:42 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-14576f4a-fcff-4245-9894-da330829f14f tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7" returned: 0 in 0.489s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-14576f4a-fcff-4245-9894-da330829f14f tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:42 devstack sudo[88166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7
Apr 24 20:00:42 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:42 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-14576f4a-fcff-4245-9894-da330829f14f tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7" returned: 1 in 0.526s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-14576f4a-fcff-4245-9894-da330829f14f tempest-VolumesExtendTest-1780557260 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 20:00:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-14576f4a-fcff-4245-9894-da330829f14f tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 2G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-14576f4a-fcff-4245-9894-da330829f14f tempest-VolumesExtendTest-1780557260 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 2G" returned: 0 in 0.082s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-14576f4a-fcff-4245-9894-da330829f14f tempest-VolumesExtendTest-1780557260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.136s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:42 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] GroupSnapshot 070da114-5bcb-447b-9f38-0706926c1f98: creating.
Apr 24 20:00:42 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-14576f4a-fcff-4245-9894-da330829f14f tempest-VolumesExtendTest-1780557260 None] Extend volume completed successfully.
Apr 24 20:00:42 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] Group snapshot 070da114-5bcb-447b-9f38-0706926c1f98: creating. {{(pid=81241) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 24 20:00:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] Creating offline snapshot 2a8044ba-347d-417b-ae6e-205ed7f5e600 of volume 2e753f2b-3234-4482-9e53-66ce2131ac35 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:00:42 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c5278b-73f3-490f-ae5c-09694bcb82ea]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:42 devstack sudo[88174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35
Apr 24 20:00:42 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:43 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35" returned: 0 in 0.490s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:43 devstack sudo[88179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600 1G
Apr 24 20:00:43 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Acquiring lock "cinder-4d1f24af-0758-423f-957a-ad34c3fb39c7-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Lock "cinder-4d1f24af-0758-423f-957a-ad34c3fb39c7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Acquiring lock "cinder-quobyte-4d1f24af-0758-423f-957a-ad34c3fb39c7" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Lock "cinder-quobyte-4d1f24af-0758-423f-957a-ad34c3fb39c7" acquired by "delete_volume" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:43 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35ac035-7656-4277-ae5d-5d8326795223]: (4, 'raw') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:43 devstack sudo[88184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7
Apr 24 20:00:43 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:43 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600 1G" returned: 0 in 0.606s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e753f2b-3234-4482-9e53-66ce2131ac35 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:43 devstack sudo[88186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e753f2b-3234-4482-9e53-66ce2131ac35 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600
Apr 24 20:00:43 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:44 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7" returned: 0 in 0.583s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:44 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7
Apr 24 20:00:44 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:44 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e753f2b-3234-4482-9e53-66ce2131ac35 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600" returned: 0 in 0.540s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:44 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 20:00:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:44 devstack sudo[88195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600
Apr 24 20:00:44 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:44 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7" returned: 1 in 0.523s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7' failed. Not Retrying. {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 20:00:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:44 devstack sudo[88200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7
Apr 24 20:00:44 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:44 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600" returned: 0 in 0.488s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:44 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=83,cinder:UPDATE=109,cinder:DELETE=11,cinder:INSERT=25 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:00:44 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=85,cinder:INSERT=39,cinder:UPDATE=124,cinder:DELETE=8 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:00:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:45 devstack sudo[88203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.info
Apr 24 20:00:45 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:45 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4d1f24af-0758-423f-957a-ad34c3fb39c7" returned: 0 in 0.484s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Lock "cinder-quobyte-4d1f24af-0758-423f-957a-ad34c3fb39c7" released by "delete_volume" :: held 1.659s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Created reservations ['b5182981-3c8e-49b0-8f94-ff2a364c96bd', 'fee42912-a729-4d23-9b43-4c3569df8116', '530f8f68-351f-4970-99f2-d85f65336f25', '19e952ce-21e3-4db6-89d6-f87ca04e2f60'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:45 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.info" returned: 0 in 0.493s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:45 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:45 devstack sudo[88207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:00:45 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:45 devstack sudo[88208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.info
Apr 24 20:00:45 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:45 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.info" returned: 0 in 0.486s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:45 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.204s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.536s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:45 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:00:46 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Deleted volume successfully.
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3335b02c-6027-4f48-a2fb-7cb74858bd76 tempest-VolumesExtendTest-1780557260 None] Lock "cinder-4d1f24af-0758-423f-957a-ad34c3fb39c7-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:46 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0109da53-1e79-4610-a315-8444d57a6b95 tempest-GroupSnapshotsTest-600287551 None] group_snapshot 070da114-5bcb-447b-9f38-0706926c1f98: created successfully
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Flow 'volume_create_manager' (9d5dad82-dc2f-4152-bf4f-99a6b2f20d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61653e6-85ba-47f2-96a9-a9e403de7016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61653e6-85ba-47f2-96a9-a9e403de7016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-491298622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44342355-cd92-468f-8320-c9cfafbcf7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44ab10fbc364eb49777cdf1972e5136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:46Z,use_quota=True,user_id='cd304f3f186c4141aea9dad8e83c32df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d834f2f-65c6-4da8-900f-f1d49e2de5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d834f2f-65c6-4da8-900f-f1d49e2de5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775ef0b3-da82-412c-b1b3-3c8f83611b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775ef0b3-da82-412c-b1b3-3c8f83611b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44342355-cd92-468f-8320-c9cfafbcf7e8', 'volume_name': 'volume-44342355-cd92-468f-8320-c9cfafbcf7e8', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b069ae-7d31-42c4-beeb-eb9be111d97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b069ae-7d31-42c4-beeb-eb9be111d97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a92fb0-f112-4244-adac-7d974a29bfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:46 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Volume 44342355-cd92-468f-8320-c9cfafbcf7e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44342355-cd92-468f-8320-c9cfafbcf7e8', 'volume_size': 1}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-491298622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44342355-cd92-468f-8320-c9cfafbcf7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44ab10fbc364eb49777cdf1972e5136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:46Z,use_quota=True,user_id='cd304f3f186c4141aea9dad8e83c32df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Creating volume 44342355-cd92-468f-8320-c9cfafbcf7e8 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:00:46 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:46 devstack sudo[88213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8 1073741824
Apr 24 20:00:46 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:46 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8 1073741824" returned: 0 in 0.651s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:46 devstack sudo[88218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8
Apr 24 20:00:46 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:47 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8" returned: 0 in 0.479s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:00:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:47 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a92fb0-f112-4244-adac-7d974a29bfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44342355-cd92-468f-8320-c9cfafbcf7e8', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:47 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86fcee7-186f-4567-ac4d-5a78517bbb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:00:47 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Volume volume-44342355-cd92-468f-8320-c9cfafbcf7e8 (44342355-cd92-468f-8320-c9cfafbcf7e8): created successfully
Apr 24 20:00:47 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86fcee7-186f-4567-ac4d-5a78517bbb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:00:47 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Flow 'volume_create_manager' (9d5dad82-dc2f-4152-bf4f-99a6b2f20d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:00:47 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-61ddf3a8-9816-4ec5-81a8-542015e803a6 tempest-VolumesExtendTest-1780557260 None] Created volume successfully.
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-2a8044ba-347d-417b-ae6e-205ed7f5e600-95a2def7-4edd-421c-ac02-3f392dce2159" by "_create_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-2a8044ba-347d-417b-ae6e-205ed7f5e600-95a2def7-4edd-421c-ac02-3f392dce2159" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Creating volume 95a2def7-4edd-421c-ac02-3f392dce2159 from snapshot 2a8044ba-347d-417b-ae6e-205ed7f5e600 {{(pid=81241) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-95a2def7-4edd-421c-ac02-3f392dce2159" by "_copy_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-95a2def7-4edd-421c-ac02-3f392dce2159" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] snapshot: 2a8044ba-347d-417b-ae6e-205ed7f5e600, volume: 95a2def7-4edd-421c-ac02-3f392dce2159,  {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[759e4496-ae52-4efa-8a3f-804aa899b7ed]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:48 devstack sudo[88221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600
Apr 24 20:00:48 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:48 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600" returned: 0 in 0.604s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e753f2b-3234-4482-9e53-66ce2131ac35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35 {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Creating direct copy from snapshot {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[038b10df-55d7-45ad-b66f-183a0325fb8c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:48 devstack sudo[88226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35
Apr 24 20:00:48 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:49 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35" returned: 0 in 0.572s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:49 devstack cinder-volume[81241]: DEBUG cinder.utils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Path /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159 not found in is_blk_device check {{(pid=81241) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 20:00:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:49 devstack sudo[88232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159
Apr 24 20:00:49 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:53 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159" returned: 0 in 4.326s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:53 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbe545c-4675-41f8-a013-ae4fab34a1f9]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:53 devstack sudo[88244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35
Apr 24 20:00:53 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:54 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35" returned: 0 in 0.631s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:54 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35, size 1024.00 MB, duration 4.33 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159 {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 20:00:54 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Converted 1024.00 MB image at 236.60 MB/s
Apr 24 20:00:54 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 20:00:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:54 devstack sudo[88249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159
Apr 24 20:00:54 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:54 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159" returned: 0 in 0.447s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-95a2def7-4edd-421c-ac02-3f392dce2159" released by "_copy_volume_from_snapshot" :: held 6.675s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-2a8044ba-347d-417b-ae6e-205ed7f5e600-95a2def7-4edd-421c-ac02-3f392dce2159" released by "_create_volume_from_snapshot" :: held 6.715s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.731s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.285s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] Creating offline snapshot ce121588-8f27-4687-854a-016471dd8324 of volume 44342355-cd92-468f-8320-c9cfafbcf7e8 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:00:54 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcd7203-38b6-4f97-90a9-90a101af3ae2]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:54 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-60c8fc61-047b-42f0-9fae-765f86b7e865 tempest-GroupSnapshotsTest-600287551 None] Create group from source-snapshot-070da114-5bcb-447b-9f38-0706926c1f98 completed successfully.
Apr 24 20:00:54 devstack sudo[88252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8
Apr 24 20:00:54 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-95a2def7-4edd-421c-ac02-3f392dce2159" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-95a2def7-4edd-421c-ac02-3f392dce2159" acquired by "delete_volume" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:55 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bbe3ce-bf31-490a-9922-a6e2ad12e558]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:55 devstack sudo[88257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159
Apr 24 20:00:55 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:55 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8" returned: 0 in 0.585s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:55 devstack sudo[88259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324 1G
Apr 24 20:00:55 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:55 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159" returned: 0 in 0.554s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:55 devstack sudo[88267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159
Apr 24 20:00:55 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:55 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324 1G" returned: 0 in 0.588s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44342355-cd92-468f-8320-c9cfafbcf7e8 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:55 devstack sudo[88269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44342355-cd92-468f-8320-c9cfafbcf7e8 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324
Apr 24 20:00:55 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:56 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-95a2def7-4edd-421c-ac02-3f392dce2159" returned: 0 in 0.482s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-95a2def7-4edd-421c-ac02-3f392dce2159" released by "delete_volume" :: held 1.079s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:56 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Created reservations ['338967a5-3f7d-4ac3-b3bf-4db51a06439f'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:00:56 devstack cinder-volume[81241]: WARNING cinder.quota [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-435292373 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-435292373, it is now deprecated. Please use the default quota class for default quota.
Apr 24 20:00:56 devstack cinder-volume[81241]: WARNING cinder.quota [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-435292373 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-435292373, it is now deprecated. Please use the default quota class for default quota.
Apr 24 20:00:56 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Created reservations ['3c84f9a9-5299-4197-8bb3-bc29cb4425e5', 'aa5aab4c-5ff0-4f54-b411-53775771abc8', 'b97dd849-2335-4cd5-9260-d43f2746e04b', 'f83bb398-55ce-45c1-a435-f8b4526e08a5'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:00:56 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44342355-cd92-468f-8320-c9cfafbcf7e8 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324" returned: 0 in 0.531s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:56 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324 is being set with open permissions: ugo+rw
Apr 24 20:00:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:56 devstack sudo[88275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324
Apr 24 20:00:56 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:00:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:00:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:56 devstack sudo[88277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:00:56 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:56 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324" returned: 0 in 0.479s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:56 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.431s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:57 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:00:57 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-5b250176-6226-454d-96f7-87bfbcc9a36e tempest-GroupSnapshotsTest-600287551 None] Delete group completed successfully.
Apr 24 20:00:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:57 devstack sudo[88281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.info
Apr 24 20:00:57 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:57 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.info" returned: 0 in 0.481s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:57 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.info is being set with open permissions: ugo+rw
Apr 24 20:00:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:57 devstack sudo[88284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.info
Apr 24 20:00:57 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:57 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] group_snapshot 070da114-5bcb-447b-9f38-0706926c1f98: deleting
Apr 24 20:00:57 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] group_snapshot 070da114-5bcb-447b-9f38-0706926c1f98: deleting {{(pid=81241) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 24 20:00:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-2e753f2b-3234-4482-9e53-66ce2131ac35" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-2e753f2b-3234-4482-9e53-66ce2131ac35" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-2a8044ba-347d-417b-ae6e-205ed7f5e600" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:00:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-2a8044ba-347d-417b-ae6e-205ed7f5e600" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:00:57 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] Deleting offline snapshot 2a8044ba-347d-417b-ae6e-205ed7f5e600 of volume 2e753f2b-3234-4482-9e53-66ce2131ac35 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:00:57 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] snapshot_file for this snap is: volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:00:57 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde7933e-3d9d-4cee-a37d-e32f1ff6f6a5]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:57 devstack sudo[88286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600
Apr 24 20:00:57 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:58 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.info" returned: 0 in 0.522s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.283s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:00:58 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-1b4ace38-bbd9-4fa1-ac73-d61aa3d698a2 tempest-VolumesExtendTest-1780557260 None] Create snapshot completed successfully
Apr 24 20:00:58 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600" returned: 0 in 0.579s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e753f2b-3234-4482-9e53-66ce2131ac35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:00:58 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[418a73c4-4e07-4843-bc16-820db98183bd]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:58 devstack sudo[88292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35
Apr 24 20:00:58 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:58 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35" returned: 0 in 0.515s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:58 devstack sudo[88297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600
Apr 24 20:00:58 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e7418bf8-43ab-42a6-868e-87862fef9be9 tempest-VolumesExtendTest-1780557260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:00:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e7418bf8-43ab-42a6-868e-87862fef9be9 tempest-VolumesExtendTest-1780557260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:00:59 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[82561139-a7d4-4c31-8358-f314c43c036a]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:00:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e7418bf8-43ab-42a6-868e-87862fef9be9 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:59 devstack sudo[88301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8
Apr 24 20:00:59 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:59 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600" returned: 0 in 0.554s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:59 devstack sudo[88305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600
Apr 24 20:00:59 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:00:59 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e7418bf8-43ab-42a6-868e-87862fef9be9 tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8" returned: 0 in 0.585s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e7418bf8-43ab-42a6-868e-87862fef9be9 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324 2G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:00:59 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root
Apr 24 20:00:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35.2a8044ba-347d-417b-ae6e-205ed7f5e600" returned: 0 in 0.523s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-2a8044ba-347d-417b-ae6e-205ed7f5e600" released by "_delete_snapshot" :: held 2.272s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-2e753f2b-3234-4482-9e53-66ce2131ac35" released by "delete_snapshot" :: held 2.312s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:00:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e7418bf8-43ab-42a6-868e-87862fef9be9 tempest-VolumesExtendTest-1780557260 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324 2G" returned: 0 in 0.150s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:00:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e7418bf8-43ab-42a6-868e-87862fef9be9 tempest-VolumesExtendTest-1780557260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.767s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:00 devstack cinder-volume[81241]: WARNING cinder.quota [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-435292373 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-435292373, it is now deprecated. Please use the default quota class for default quota.
Apr 24 20:01:00 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e7418bf8-43ab-42a6-868e-87862fef9be9 tempest-VolumesExtendTest-1780557260 None] Extend volume completed successfully.
Apr 24 20:01:00 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] Created reservations ['5af5f352-a995-4a79-8a7a-af4b235caf7e', 'eaa0a5ea-db92-4f89-928f-68fbb84cf4fb', '1f281230-b401-4f8d-b3e7-fcbe6aac9cb6', '136b0636-e150-4cd2-8068-6dcfd0f688d1'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:01:00 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-072d2e53-b670-45d7-9a9c-237487505fc5 tempest-GroupSnapshotsTest-600287551 None] group_snapshot 070da114-5bcb-447b-9f38-0706926c1f98: deleted successfully
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-2e753f2b-3234-4482-9e53-66ce2131ac35" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-2e753f2b-3234-4482-9e53-66ce2131ac35" acquired by "delete_volume" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[822c0d47-6043-479f-9fda-cd5061274e71]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:01 devstack sudo[88314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35
Apr 24 20:01:01 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Acquiring lock "cinder-ce121588-8f27-4687-854a-016471dd8324-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Lock "cinder-ce121588-8f27-4687-854a-016471dd8324-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Acquiring lock "cinder-quobyte-44342355-cd92-468f-8320-c9cfafbcf7e8" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Lock "cinder-quobyte-44342355-cd92-468f-8320-c9cfafbcf7e8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Acquiring lock "cinder-quobyte-ce121588-8f27-4687-854a-016471dd8324" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Lock "cinder-quobyte-ce121588-8f27-4687-854a-016471dd8324" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Deleting offline snapshot ce121588-8f27-4687-854a-016471dd8324 of volume 44342355-cd92-468f-8320-c9cfafbcf7e8 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] snapshot_file for this snap is: volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[19794e32-0a53-4b55-ad35-63407e5ec893]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:01 devstack sudo[88316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324
Apr 24 20:01:01 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:01 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35" returned: 0 in 0.563s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:01 devstack sudo[88321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35
Apr 24 20:01:01 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:02 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324" returned: 0 in 0.517s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44342355-cd92-468f-8320-c9cfafbcf7e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb435136-82e1-4bfc-9c37-5139cb1cdd92]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:02 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2e753f2b-3234-4482-9e53-66ce2131ac35" returned: 0 in 0.439s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-2e753f2b-3234-4482-9e53-66ce2131ac35" released by "delete_volume" :: held 1.088s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:02 devstack sudo[88327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8
Apr 24 20:01:02 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Created reservations ['e6b1d79f-acc4-4b80-bb35-799a93397f85'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:01:02 devstack cinder-volume[81241]: WARNING cinder.db.sqlalchemy.api [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-435292373']
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Created reservations ['15c61024-ff71-4d88-8de2-066cbca85af1', '02c9f791-4263-4711-893c-23de93298950', 'ce9d33a8-4ac0-498e-9fc2-082419875118', '6f625bd7-7e84-4230-8d55-185cdf898a16'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:02 devstack sudo[88329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:01:02 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:02 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8" returned: 0 in 0.537s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:02 devstack sudo[88334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324
Apr 24 20:01:02 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:02 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.445s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:02 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:01:02 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a2c2db54-7920-425a-a3e5-c8ae9510cfd8 tempest-GroupSnapshotsTest-600287551 None] Delete group completed successfully.
Apr 24 20:01:03 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324" returned: 0 in 0.559s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:03 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324
Apr 24 20:01:03 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:03 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e490afdb-3305-4228-81fb-8953eccebb0a tempest-GroupSnapshotsTest-600287551 None] Group tempest-GroupSnapshotsTest-Group-1752510528: creating
Apr 24 20:01:03 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e490afdb-3305-4228-81fb-8953eccebb0a tempest-GroupSnapshotsTest-600287551 None] Group tempest-GroupSnapshotsTest-Group-1752510528: created successfully
Apr 24 20:01:03 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e490afdb-3305-4228-81fb-8953eccebb0a tempest-GroupSnapshotsTest-600287551 None] Create group completed successfully.
Apr 24 20:01:03 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8.ce121588-8f27-4687-854a-016471dd8324" returned: 0 in 0.515s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Lock "cinder-quobyte-ce121588-8f27-4687-854a-016471dd8324" released by "_delete_snapshot" :: held 2.222s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Lock "cinder-quobyte-44342355-cd92-468f-8320-c9cfafbcf7e8" released by "delete_snapshot" :: held 2.251s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:03 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Created reservations ['3bd677aa-b0e2-46f2-82db-fb1ce083a834', '21cede0a-18ee-4bfa-8f1b-0a2810f69b16', '721b209c-563b-4978-a9e2-ac72e5ee7fd6', 'd42a8a99-4284-4648-bf4e-55d96ff8be04'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:01:03 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Delete snapshot completed successfully.
Apr 24 20:01:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-35f32a53-7643-49e1-8c28-dbc1358fe769 tempest-VolumesExtendTest-1780557260 None] Lock "cinder-ce121588-8f27-4687-854a-016471dd8324-delete_snapshot" released by "delete_snapshot" :: held 2.371s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Acquiring lock "cinder-44342355-cd92-468f-8320-c9cfafbcf7e8-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Lock "cinder-44342355-cd92-468f-8320-c9cfafbcf7e8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Acquiring lock "cinder-quobyte-44342355-cd92-468f-8320-c9cfafbcf7e8" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Lock "cinder-quobyte-44342355-cd92-468f-8320-c9cfafbcf7e8" acquired by "delete_volume" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:04 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1c95c3-e512-417f-bff1-ac0ad29e885d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:04 devstack sudo[88345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8
Apr 24 20:01:04 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Flow 'volume_create_manager' (21bc860e-5e30-4a17-898d-662d1e536955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f48bfc-8a05-4899-b040-d6c2df9fae16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f48bfc-8a05-4899-b040-d6c2df9fae16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-743659501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a6eba2ae-6bf3-49ac-bfda-e6eded0cd84b,host='devstack@QuobyteHD#QuobyteHD',id=dd166d6e-901e-48bb-b28d-d7527e8a2382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dce998047af4877a4651e632d6ddfdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:05Z,use_quota=True,user_id='7a2c9c890c7a40f6b8c51b785c5b52b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bfa08ef-75e6-454c-9e2b-f28c72a9009c),volume_type_id=6bfa08ef-75e6-454c-9e2b-f28c72a9009c)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd65e49-cddf-4857-9c04-feeee32ceac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd65e49-cddf-4857-9c04-feeee32ceac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b2fafb-c53e-4b08-8e8b-64bdbfff6bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b2fafb-c53e-4b08-8e8b-64bdbfff6bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd166d6e-901e-48bb-b28d-d7527e8a2382', 'volume_name': 'volume-dd166d6e-901e-48bb-b28d-d7527e8a2382', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd7e5d2-a438-4f8f-a7e7-010a4c418220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd7e5d2-a438-4f8f-a7e7-010a4c418220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e695614a-3cc9-4a95-b423-a91d38df971c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:05 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Volume dd166d6e-901e-48bb-b28d-d7527e8a2382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd166d6e-901e-48bb-b28d-d7527e8a2382', 'volume_size': 1}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a6eba2ae-6bf3-49ac-bfda-e6eded0cd84b,created_at=2026-04-24T18:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-743659501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a6eba2ae-6bf3-49ac-bfda-e6eded0cd84b,host='devstack@QuobyteHD#QuobyteHD',id=dd166d6e-901e-48bb-b28d-d7527e8a2382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dce998047af4877a4651e632d6ddfdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:05Z,use_quota=True,user_id='7a2c9c890c7a40f6b8c51b785c5b52b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bfa08ef-75e6-454c-9e2b-f28c72a9009c),volume_type_id=6bfa08ef-75e6-454c-9e2b-f28c72a9009c)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Creating volume dd166d6e-901e-48bb-b28d-d7527e8a2382 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:01:05 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:05 devstack sudo[88347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382 1073741824
Apr 24 20:01:05 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:05 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8" returned: 0 in 0.587s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:05 devstack sudo[88352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8
Apr 24 20:01:05 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:05 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382 1073741824" returned: 0 in 0.634s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:05 devstack sudo[88358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382
Apr 24 20:01:05 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:05 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-44342355-cd92-468f-8320-c9cfafbcf7e8" returned: 0 in 0.499s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Lock "cinder-quobyte-44342355-cd92-468f-8320-c9cfafbcf7e8" released by "delete_volume" :: held 1.153s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:05 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Created reservations ['9e844162-a416-4e2a-98ee-0cd6ac526a61', 'c166b6af-353e-4d3f-bdb4-dfad4b3ee92e', '5eb43c64-c407-4afa-90bf-63747d52d2ef', '3c22c73b-520b-493b-ba73-d9fca704a1a5'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:06 devstack sudo[88360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:01:06 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:06 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382" returned: 0 in 0.470s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e695614a-3cc9-4a95-b423-a91d38df971c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd166d6e-901e-48bb-b28d-d7527e8a2382', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f157885-3f2e-4fa9-aaba-753311d50903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:06 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Volume volume-dd166d6e-901e-48bb-b28d-d7527e8a2382 (dd166d6e-901e-48bb-b28d-d7527e8a2382): created successfully
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f157885-3f2e-4fa9-aaba-753311d50903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Flow 'volume_create_manager' (21bc860e-5e30-4a17-898d-662d1e536955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:01:06 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-091011ff-efd1-4244-8bd6-977a914f4299 tempest-GroupSnapshotsTest-600287551 None] Created volume successfully.
Apr 24 20:01:06 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.474s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:01:06 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Deleted volume successfully.
Apr 24 20:01:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e7c5e7c9-8e86-468c-8d81-586071add57c tempest-VolumesExtendTest-1780557260 None] Lock "cinder-44342355-cd92-468f-8320-c9cfafbcf7e8-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Flow 'volume_create_manager' (fcea607b-7ead-4ab3-a66e-939a90404062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743994ff-f19e-4f40-84f6-9fd8abcbde5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743994ff-f19e-4f40-84f6-9fd8abcbde5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-201249781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a6eba2ae-6bf3-49ac-bfda-e6eded0cd84b,host='devstack@QuobyteHD#QuobyteHD',id=b81d0156-08e2-493b-8efa-45dfb3caa282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dce998047af4877a4651e632d6ddfdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:08Z,use_quota=True,user_id='7a2c9c890c7a40f6b8c51b785c5b52b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bfa08ef-75e6-454c-9e2b-f28c72a9009c),volume_type_id=6bfa08ef-75e6-454c-9e2b-f28c72a9009c)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafc5923-4c9d-4f80-b562-926e5784da86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafc5923-4c9d-4f80-b562-926e5784da86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a671ecd9-26b1-438a-965a-65854530b391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a671ecd9-26b1-438a-965a-65854530b391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b81d0156-08e2-493b-8efa-45dfb3caa282', 'volume_name': 'volume-b81d0156-08e2-493b-8efa-45dfb3caa282', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5427cc3c-65ac-4f6f-b715-211c5892fb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5427cc3c-65ac-4f6f-b715-211c5892fb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd76ebc-db28-4d5c-869b-b3b77f0c1fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:07 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Volume b81d0156-08e2-493b-8efa-45dfb3caa282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b81d0156-08e2-493b-8efa-45dfb3caa282', 'volume_size': 1}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a6eba2ae-6bf3-49ac-bfda-e6eded0cd84b,created_at=2026-04-24T18:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-201249781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a6eba2ae-6bf3-49ac-bfda-e6eded0cd84b,host='devstack@QuobyteHD#QuobyteHD',id=b81d0156-08e2-493b-8efa-45dfb3caa282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dce998047af4877a4651e632d6ddfdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:08Z,use_quota=True,user_id='7a2c9c890c7a40f6b8c51b785c5b52b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bfa08ef-75e6-454c-9e2b-f28c72a9009c),volume_type_id=6bfa08ef-75e6-454c-9e2b-f28c72a9009c)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Creating volume b81d0156-08e2-493b-8efa-45dfb3caa282 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:01:07 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:01:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:07 devstack sudo[88364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282 1073741824
Apr 24 20:01:07 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:08 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282 1073741824" returned: 0 in 0.687s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:08 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282
Apr 24 20:01:08 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:08 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282" returned: 0 in 0.497s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd76ebc-db28-4d5c-869b-b3b77f0c1fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b81d0156-08e2-493b-8efa-45dfb3caa282', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1183207b-33c0-45ae-9e9e-b8662a20fbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:09 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Volume volume-b81d0156-08e2-493b-8efa-45dfb3caa282 (b81d0156-08e2-493b-8efa-45dfb3caa282): created successfully
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1183207b-33c0-45ae-9e9e-b8662a20fbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Flow 'volume_create_manager' (fcea607b-7ead-4ab3-a66e-939a90404062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:01:09 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b5a9a0f7-5078-4406-b913-42e7c41163e0 tempest-GroupSnapshotsTest-600287551 None] Created volume successfully.
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Flow 'volume_create_manager' (8dbb5056-bb41-4888-a720-e34bcf58106e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01a87fa-fad2-4f7a-af20-db30b79f516a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01a87fa-fad2-4f7a-af20-db30b79f516a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1827477809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2738b34b-4abf-4a8e-aa84-0462054d9e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70d66bfba7e4e179db3fef6fe98c71d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:09Z,use_quota=True,user_id='9c3225e79ca7421ea304e58fd1fd774c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f7ea8f-4175-4e06-84b0-4076528ef67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f7ea8f-4175-4e06-84b0-4076528ef67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fcaf18-5d7f-4ddb-9017-c51ef72430c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fcaf18-5d7f-4ddb-9017-c51ef72430c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2738b34b-4abf-4a8e-aa84-0462054d9e70', 'volume_name': 'volume-2738b34b-4abf-4a8e-aa84-0462054d9e70', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea6a177-b0ef-4826-9316-c6569379f50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea6a177-b0ef-4826-9316-c6569379f50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19026d7e-f1a5-4bda-a3cd-cb471d055c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:09 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Volume 2738b34b-4abf-4a8e-aa84-0462054d9e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2738b34b-4abf-4a8e-aa84-0462054d9e70', 'volume_size': 1}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1827477809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2738b34b-4abf-4a8e-aa84-0462054d9e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70d66bfba7e4e179db3fef6fe98c71d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:09Z,use_quota=True,user_id='9c3225e79ca7421ea304e58fd1fd774c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Creating volume 2738b34b-4abf-4a8e-aa84-0462054d9e70 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:01:09 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:01:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2738b34b-4abf-4a8e-aa84-0462054d9e70 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:09 devstack sudo[88374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2738b34b-4abf-4a8e-aa84-0462054d9e70 1073741824
Apr 24 20:01:09 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:10 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b2c21444-56b3-445e-829e-b08442583618 tempest-GroupSnapshotsTest-600287551 None] Update group completed successfully.
Apr 24 20:01:10 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2738b34b-4abf-4a8e-aa84-0462054d9e70 1073741824" returned: 0 in 0.627s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2738b34b-4abf-4a8e-aa84-0462054d9e70 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:10 devstack sudo[88379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2738b34b-4abf-4a8e-aa84-0462054d9e70
Apr 24 20:01:10 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:10 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2738b34b-4abf-4a8e-aa84-0462054d9e70" returned: 0 in 0.439s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:10 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:01:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19026d7e-f1a5-4bda-a3cd-cb471d055c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2738b34b-4abf-4a8e-aa84-0462054d9e70', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62fad89f-7bba-4051-a97d-0c81c34fd775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:10 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Volume volume-2738b34b-4abf-4a8e-aa84-0462054d9e70 (2738b34b-4abf-4a8e-aa84-0462054d9e70): created successfully
Apr 24 20:01:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62fad89f-7bba-4051-a97d-0c81c34fd775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Flow 'volume_create_manager' (8dbb5056-bb41-4888-a720-e34bcf58106e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:01:10 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-6275e586-8738-4a8e-ac47-979c8431bd35 tempest-VolumesNegativeTest-417317810 None] Created volume successfully.
Apr 24 20:01:11 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-98229c5a-2fff-4638-9f4c-5f918080112d tempest-GroupSnapshotsTest-600287551 None] Update group completed successfully.
Apr 24 20:01:12 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d121b3f4-969e-4258-a8fc-d72ac38e8a54 tempest-GroupSnapshotsTest-600287551 None] Update group completed successfully.
Apr 24 20:01:13 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-07a675bf-0bec-4a95-877a-38e04dfdc7ca tempest-GroupSnapshotsTest-600287551 None] Update group completed successfully.
Apr 24 20:01:14 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] GroupSnapshot 2a64f9a3-d144-435d-b6fd-7055ac93dd1f: creating.
Apr 24 20:01:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Group snapshot 2a64f9a3-d144-435d-b6fd-7055ac93dd1f: creating. {{(pid=81241) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 24 20:01:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:14 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Creating offline snapshot 0e0ccbe9-fed4-4155-b6e9-7e9f02645a98 of volume b81d0156-08e2-493b-8efa-45dfb3caa282 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:01:14 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e341b0-ae35-46e4-8f7c-91e571673a29]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:14 devstack sudo[88387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282
Apr 24 20:01:14 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:15 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282" returned: 0 in 0.531s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:15 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98 1G
Apr 24 20:01:15 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:15 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98 1G" returned: 0 in 0.585s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81d0156-08e2-493b-8efa-45dfb3caa282 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:15 devstack sudo[88397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81d0156-08e2-493b-8efa-45dfb3caa282 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98
Apr 24 20:01:16 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:16 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81d0156-08e2-493b-8efa-45dfb3caa282 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98" returned: 0 in 0.520s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:16 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 20:01:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:16 devstack sudo[88402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98
Apr 24 20:01:16 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:16 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98" returned: 0 in 0.436s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:16 devstack sudo[88405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.info
Apr 24 20:01:16 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:17 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.info" returned: 0 in 0.484s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:17 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 20:01:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:17 devstack sudo[88408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.info
Apr 24 20:01:17 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:17 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.info" returned: 0 in 0.472s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.109s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:17 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Creating offline snapshot c0bc65b3-c704-4b92-abf9-89532897a8e8 of volume dd166d6e-901e-48bb-b28d-d7527e8a2382 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:01:17 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e1f402-7f69-42de-8312-80967a63bf0d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:18 devstack sudo[88411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382
Apr 24 20:01:18 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:18 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382" returned: 0 in 0.566s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:18 devstack sudo[88416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8 1G
Apr 24 20:01:18 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:19 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8 1G" returned: 0 in 0.672s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd166d6e-901e-48bb-b28d-d7527e8a2382 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:19 devstack sudo[88437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd166d6e-901e-48bb-b28d-d7527e8a2382 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8
Apr 24 20:01:19 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:19 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd166d6e-901e-48bb-b28d-d7527e8a2382 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8" returned: 0 in 0.493s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:19 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 20:01:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:19 devstack sudo[88449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8
Apr 24 20:01:19 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:20 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8" returned: 0 in 0.458s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:20 devstack sudo[88452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.info
Apr 24 20:01:20 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:20 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.info" returned: 0 in 0.441s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:20 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 20:01:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:20 devstack sudo[88455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.info
Apr 24 20:01:20 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:21 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.info" returned: 0 in 0.445s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.172s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:21 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-50dc9b9a-9381-4237-bef0-e8c0b366e210 tempest-GroupSnapshotsTest-600287551 None] group_snapshot 2a64f9a3-d144-435d-b6fd-7055ac93dd1f: created successfully
Apr 24 20:01:22 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] group_snapshot 2a64f9a3-d144-435d-b6fd-7055ac93dd1f: deleting
Apr 24 20:01:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] group_snapshot 2a64f9a3-d144-435d-b6fd-7055ac93dd1f: deleting {{(pid=81241) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 24 20:01:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-b81d0156-08e2-493b-8efa-45dfb3caa282" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-b81d0156-08e2-493b-8efa-45dfb3caa282" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-0e0ccbe9-fed4-4155-b6e9-7e9f02645a98" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-0e0ccbe9-fed4-4155-b6e9-7e9f02645a98" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:22 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Deleting offline snapshot 0e0ccbe9-fed4-4155-b6e9-7e9f02645a98 of volume b81d0156-08e2-493b-8efa-45dfb3caa282 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:01:22 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] snapshot_file for this snap is: volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:01:22 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9f9a2f-b2ff-4968-ba73-dc39a1caa9eb]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:22 devstack sudo[88460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98
Apr 24 20:01:22 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:22 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98" returned: 0 in 0.563s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:22 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b81d0156-08e2-493b-8efa-45dfb3caa282(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:01:23 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d2f9dc-00ca-4104-8288-cbd004684f8c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:23 devstack sudo[88468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282
Apr 24 20:01:23 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:23 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282" returned: 0 in 0.572s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:23 devstack sudo[88473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98
Apr 24 20:01:23 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 20:01:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:01:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:01:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:24 devstack sudo[88476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:01:24 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:24 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98" returned: 0 in 0.633s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:24 devstack sudo[88483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98
Apr 24 20:01:24 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:24 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.556s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:01:24 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282.0e0ccbe9-fed4-4155-b6e9-7e9f02645a98" returned: 0 in 0.533s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-0e0ccbe9-fed4-4155-b6e9-7e9f02645a98" released by "_delete_snapshot" :: held 2.407s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-b81d0156-08e2-493b-8efa-45dfb3caa282" released by "delete_snapshot" :: held 2.429s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-dd166d6e-901e-48bb-b28d-d7527e8a2382" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-dd166d6e-901e-48bb-b28d-d7527e8a2382" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-c0bc65b3-c704-4b92-abf9-89532897a8e8" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-c0bc65b3-c704-4b92-abf9-89532897a8e8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Deleting offline snapshot c0bc65b3-c704-4b92-abf9-89532897a8e8 of volume dd166d6e-901e-48bb-b28d-d7527e8a2382 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] snapshot_file for this snap is: volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce91de0-6ac0-42b0-8221-08e3b37add97]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:24 devstack sudo[88496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8
Apr 24 20:01:24 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:25 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8" returned: 0 in 0.609s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd166d6e-901e-48bb-b28d-d7527e8a2382(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:01:25 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc298de4-4d45-4df3-9011-ec2c33c3beae]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:25 devstack sudo[88521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382
Apr 24 20:01:25 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:26 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382" returned: 0 in 0.750s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:26 devstack sudo[88541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8
Apr 24 20:01:26 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:26 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8" returned: 0 in 0.593s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:26 devstack sudo[88547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8
Apr 24 20:01:26 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:27 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382.c0bc65b3-c704-4b92-abf9-89532897a8e8" returned: 0 in 0.585s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:27 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-c0bc65b3-c704-4b92-abf9-89532897a8e8" released by "_delete_snapshot" :: held 2.661s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:27 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-dd166d6e-901e-48bb-b28d-d7527e8a2382" released by "delete_snapshot" :: held 2.687s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:27 devstack cinder-volume[81241]: WARNING cinder.quota [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1525184443 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1525184443, it is now deprecated. Please use the default quota class for default quota.
Apr 24 20:01:27 devstack cinder-volume[81241]: WARNING cinder.quota [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1525184443 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1525184443, it is now deprecated. Please use the default quota class for default quota.
Apr 24 20:01:27 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Created reservations ['09a39eb8-fab2-44e5-a200-820a49d34978', '4ea115b3-aa5e-491b-b3f6-1fc4152530e3', 'fca06290-c7a1-4441-8ae5-5158ff2999c9', 'a6da6d3a-5891-4b2e-a8d8-72c10cc3ba78'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:01:27 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] Created reservations ['7438f7f4-be7e-4bdd-b25d-cb87d882197e', '3665282d-31a7-4e8f-900f-c16ff3d4abd6', '6891484c-6219-4838-8a6c-a51ce9b3f217', '963e71a7-72a1-4033-ad7d-ad6245423a00'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:01:27 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-174c8316-205e-46b4-aabc-97e7061942b9 tempest-GroupSnapshotsTest-600287551 None] group_snapshot 2a64f9a3-d144-435d-b6fd-7055ac93dd1f: deleted successfully
Apr 24 20:01:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-b81d0156-08e2-493b-8efa-45dfb3caa282" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-b81d0156-08e2-493b-8efa-45dfb3caa282" acquired by "delete_volume" :: waited 0.027s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:29 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7ee386-4962-4637-9a7a-892767ac67c1]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:29 devstack sudo[88552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282
Apr 24 20:01:29 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:29 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282" returned: 0 in 0.605s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:29 devstack sudo[88566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282
Apr 24 20:01:29 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:30 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b81d0156-08e2-493b-8efa-45dfb3caa282" returned: 0 in 0.622s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-b81d0156-08e2-493b-8efa-45dfb3caa282" released by "delete_volume" :: held 1.339s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-dd166d6e-901e-48bb-b28d-d7527e8a2382" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-dd166d6e-901e-48bb-b28d-d7527e8a2382" acquired by "delete_volume" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:30 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b61729-c81a-4433-9e7d-81e3875b8a55]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:30 devstack sudo[88591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382
Apr 24 20:01:30 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:31 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382" returned: 0 in 0.564s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:31 devstack sudo[88596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382
Apr 24 20:01:31 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:31 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dd166d6e-901e-48bb-b28d-d7527e8a2382" returned: 0 in 0.520s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:31 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-dd166d6e-901e-48bb-b28d-d7527e8a2382" released by "delete_volume" :: held 1.140s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:31 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Created reservations ['5ecfc8f0-54a3-4a12-a959-0d6c7b84c247'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:01:31 devstack cinder-volume[81241]: WARNING cinder.quota [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1525184443 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1525184443, it is now deprecated. Please use the default quota class for default quota.
Apr 24 20:01:31 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Created reservations ['d85dfa85-3b07-4523-a754-6bcc83181e30', '5a463c2b-e342-4c39-96a6-d75ab4ef842a', '4ef6726c-e44e-4919-9a20-ee4d2026def0', 'b3db8979-e0d7-4eca-b564-8e8f6a31d62d'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:01:31 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Created reservations ['3a985f84-df27-44b3-a0f2-28b500a05d08', '3e179d6c-27b1-453e-80b0-ca14645db7f3', 'a12fa62d-1347-40c6-9e96-1b5b7f9a394d', '11dc5455-094f-4b05-95d6-2cb99f4147b1'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:01:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:01:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:01:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:32 devstack sudo[88601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:01:32 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:32 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.480s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:32 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:01:32 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d2c5d61b-0144-4927-93f9-586828fbc54c tempest-GroupSnapshotsTest-600287551 None] Delete group completed successfully.
Apr 24 20:01:32 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-bb443819-5a64-4c9b-86a5-29bb69767d2a tempest-GroupSnapshotsTest-600287551 None] Group tempest-GroupSnapshotsTest-Group-208651537: creating
Apr 24 20:01:32 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-bb443819-5a64-4c9b-86a5-29bb69767d2a tempest-GroupSnapshotsTest-600287551 None] Group tempest-GroupSnapshotsTest-Group-208651537: created successfully
Apr 24 20:01:32 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-bb443819-5a64-4c9b-86a5-29bb69767d2a tempest-GroupSnapshotsTest-600287551 None] Create group completed successfully.
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Flow 'volume_create_manager' (84bb9afa-4aba-4212-8ebc-01c7738d16f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752b28bc-a1b9-47e8-9636-dafca9e963cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752b28bc-a1b9-47e8-9636-dafca9e963cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1498909093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=387ac870-e2df-42b8-bd25-e6126573d7b6,host='devstack@QuobyteHD#QuobyteHD',id=e7c67fc1-b030-46ad-8ada-73119f19c3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dce998047af4877a4651e632d6ddfdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:34Z,use_quota=True,user_id='7a2c9c890c7a40f6b8c51b785c5b52b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5549c45-bec6-44a3-99b4-33266783de88),volume_type_id=b5549c45-bec6-44a3-99b4-33266783de88)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522e7691-a903-454f-9c0e-2e32b20b0cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522e7691-a903-454f-9c0e-2e32b20b0cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1bb715-1386-4235-9e35-52dc5fb12dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1bb715-1386-4235-9e35-52dc5fb12dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c67fc1-b030-46ad-8ada-73119f19c3d8', 'volume_name': 'volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcec8a40-bac5-475e-9c45-33eee6869b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcec8a40-bac5-475e-9c45-33eee6869b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee9ca3a-d641-4101-b526-32934dc589b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:34 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Volume e7c67fc1-b030-46ad-8ada-73119f19c3d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8', 'volume_size': 1}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=387ac870-e2df-42b8-bd25-e6126573d7b6,created_at=2026-04-24T18:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1498909093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=387ac870-e2df-42b8-bd25-e6126573d7b6,host='devstack@QuobyteHD#QuobyteHD',id=e7c67fc1-b030-46ad-8ada-73119f19c3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dce998047af4877a4651e632d6ddfdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:34Z,use_quota=True,user_id='7a2c9c890c7a40f6b8c51b785c5b52b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5549c45-bec6-44a3-99b4-33266783de88),volume_type_id=b5549c45-bec6-44a3-99b4-33266783de88)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Creating volume e7c67fc1-b030-46ad-8ada-73119f19c3d8 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:01:34 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:01:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:34 devstack sudo[88604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8 1073741824
Apr 24 20:01:34 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:35 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8 1073741824" returned: 0 in 0.646s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:35 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8
Apr 24 20:01:35 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:35 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8" returned: 0 in 0.488s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:01:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee9ca3a-d641-4101-b526-32934dc589b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ea2738-b17b-4a70-90af-473abd462297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:35 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Volume volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8 (e7c67fc1-b030-46ad-8ada-73119f19c3d8): created successfully
Apr 24 20:01:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ea2738-b17b-4a70-90af-473abd462297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Flow 'volume_create_manager' (84bb9afa-4aba-4212-8ebc-01c7738d16f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:01:35 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e64b607f-4b41-4f12-ae46-c8ac74339541 tempest-GroupSnapshotsTest-600287551 None] Created volume successfully.
Apr 24 20:01:36 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] GroupSnapshot 9e8c2b94-02a1-4f8d-ac6c-1e1287ad8153: creating.
Apr 24 20:01:36 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] Group snapshot 9e8c2b94-02a1-4f8d-ac6c-1e1287ad8153: creating. {{(pid=81241) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 24 20:01:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:36 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] Creating offline snapshot beaa0364-1912-420e-9774-51d24f6c6464 of volume e7c67fc1-b030-46ad-8ada-73119f19c3d8 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:01:36 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[751d8711-aa90-49fd-a249-983fce58866b]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:36 devstack sudo[88612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8
Apr 24 20:01:36 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:37 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8" returned: 0 in 0.556s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:37 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464 1G
Apr 24 20:01:37 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:37 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464 1G" returned: 0 in 0.639s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:37 devstack sudo[88622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464
Apr 24 20:01:37 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:38 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464" returned: 0 in 0.486s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:38 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 20:01:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:38 devstack sudo[88628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464
Apr 24 20:01:38 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:38 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464" returned: 0 in 0.520s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:39 devstack sudo[88632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.info
Apr 24 20:01:39 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:39 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.info" returned: 0 in 0.531s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:39 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 20:01:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:39 devstack sudo[88636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.info
Apr 24 20:01:39 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:40 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.info" returned: 0 in 0.510s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.322s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:40 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-faef03b4-dc1c-47d2-b069-6a1c018f8ce6 tempest-GroupSnapshotsTest-600287551 None] group_snapshot 9e8c2b94-02a1-4f8d-ac6c-1e1287ad8153: created successfully
Apr 24 20:01:41 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] group_snapshot 9e8c2b94-02a1-4f8d-ac6c-1e1287ad8153: deleting
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] group_snapshot 9e8c2b94-02a1-4f8d-ac6c-1e1287ad8153: deleting {{(pid=81241) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-e7c67fc1-b030-46ad-8ada-73119f19c3d8" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-e7c67fc1-b030-46ad-8ada-73119f19c3d8" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-beaa0364-1912-420e-9774-51d24f6c6464" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-beaa0364-1912-420e-9774-51d24f6c6464" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Deleting offline snapshot beaa0364-1912-420e-9774-51d24f6c6464 of volume e7c67fc1-b030-46ad-8ada-73119f19c3d8 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] snapshot_file for this snap is: volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7757cf-e715-4268-a85e-80d1f9d30748]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:41 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464
Apr 24 20:01:41 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:41 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464" returned: 0 in 0.554s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Acquiring lock "cinder-2738b34b-4abf-4a8e-aa84-0462054d9e70-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e11d07-3b2c-443c-81f3-eb2eba16db84]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Lock "cinder-2738b34b-4abf-4a8e-aa84-0462054d9e70-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Acquiring lock "cinder-quobyte-2738b34b-4abf-4a8e-aa84-0462054d9e70" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Lock "cinder-quobyte-2738b34b-4abf-4a8e-aa84-0462054d9e70" acquired by "delete_volume" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:41 devstack sudo[88678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8
Apr 24 20:01:41 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4201a4-c7fc-4691-aeb9-1d85dfcf0e9d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2738b34b-4abf-4a8e-aa84-0462054d9e70 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:42 devstack sudo[88680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2738b34b-4abf-4a8e-aa84-0462054d9e70
Apr 24 20:01:42 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:42 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8" returned: 0 in 0.554s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:42 devstack sudo[88687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464
Apr 24 20:01:42 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:42 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2738b34b-4abf-4a8e-aa84-0462054d9e70" returned: 0 in 0.557s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2738b34b-4abf-4a8e-aa84-0462054d9e70 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:42 devstack sudo[88690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2738b34b-4abf-4a8e-aa84-0462054d9e70
Apr 24 20:01:42 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:42 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464" returned: 0 in 0.566s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:42 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2738b34b-4abf-4a8e-aa84-0462054d9e70" returned: 0 in 0.473s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:42 devstack sudo[88696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464
Apr 24 20:01:42 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Lock "cinder-quobyte-2738b34b-4abf-4a8e-aa84-0462054d9e70" released by "delete_volume" :: held 1.070s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:43 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Created reservations ['f382f979-4f4b-4c42-ae75-51b1b3c97a2b', '4651b6fd-a815-4678-85fa-59883d8edacb', '661855b5-06ba-4ee6-9dc5-4655b8670d1f', 'dd6f66a8-97f4-4d56-aba1-6f99f03b7419'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:01:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:01:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:01:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:43 devstack sudo[88698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:01:43 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:43 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8.beaa0364-1912-420e-9774-51d24f6c6464" returned: 0 in 0.477s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-beaa0364-1912-420e-9774-51d24f6c6464" released by "_delete_snapshot" :: held 2.276s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-e7c67fc1-b030-46ad-8ada-73119f19c3d8" released by "delete_snapshot" :: held 2.301s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:43 devstack cinder-volume[81241]: WARNING cinder.quota [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-792480816 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-792480816, it is now deprecated. Please use the default quota class for default quota.
Apr 24 20:01:43 devstack cinder-volume[81241]: WARNING cinder.quota [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-792480816 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-792480816, it is now deprecated. Please use the default quota class for default quota.
Apr 24 20:01:43 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] Created reservations ['df15ab8f-7117-4456-9027-0de18d09a77e', '53c1c832-875c-4f67-aeac-451282db7699', 'bdfd31c3-bbc9-41e4-af5d-37cb9b370d54', '1b4a8903-f732-4db9-98d6-87d1f35cc4e2'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:01:43 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.464s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:43 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:01:43 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Deleted volume successfully.
Apr 24 20:01:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-30d455b2-0663-4de3-aa95-31b25657fca0 tempest-VolumesNegativeTest-417317810 None] Lock "cinder-2738b34b-4abf-4a8e-aa84-0462054d9e70-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:43 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a9bd48d9-f4a8-4f2c-bfae-714ea24271e0 tempest-GroupSnapshotsTest-600287551 None] group_snapshot 9e8c2b94-02a1-4f8d-ac6c-1e1287ad8153: deleted successfully
Apr 24 20:01:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "cinder-quobyte-e7c67fc1-b030-46ad-8ada-73119f19c3d8" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-e7c67fc1-b030-46ad-8ada-73119f19c3d8" acquired by "delete_volume" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:44 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27db354-4f97-405d-8668-f1be996d2620]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:44 devstack sudo[88702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8
Apr 24 20:01:44 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:45 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8" returned: 0 in 0.598s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:45 devstack sudo[88707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8
Apr 24 20:01:45 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:45 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e7c67fc1-b030-46ad-8ada-73119f19c3d8" returned: 0 in 0.484s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Lock "cinder-quobyte-e7c67fc1-b030-46ad-8ada-73119f19c3d8" released by "delete_volume" :: held 1.151s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:01:45 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=132,cinder:INSERT=33,cinder:UPDATE=133,cinder:DELETE=7 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:01:45 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=123,cinder:INSERT=28,cinder:UPDATE=122,cinder:DELETE=2 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:01:45 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Created reservations ['c0a3462b-dc28-4348-91de-629447222b57'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:01:45 devstack cinder-volume[81241]: WARNING cinder.quota [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-792480816 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-792480816, it is now deprecated. Please use the default quota class for default quota.
Apr 24 20:01:45 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Created reservations ['b0c69b3f-8d2b-4e65-bcce-3e098f5716a7', 'd346bd71-c59e-4662-b197-b730091dc06b', '5458ce1c-b59c-4d2b-a1b5-fae78c3aee1e', 'e74fa7d4-fef0-44a5-b51b-e3a793b5a6c1'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:01:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:01:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:01:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:46 devstack sudo[88710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:01:46 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:46 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.551s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:46 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:01:46 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-7882f19d-8834-40fd-b628-7a21e3dba586 tempest-GroupSnapshotsTest-600287551 None] Delete group completed successfully.
Apr 24 20:01:51 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0f5bdd5b-beb1-4529-b9ff-f4104b5edc42 tempest-GroupSnapshotsV319Test-1065350276 None] Group tempest-GroupSnapshotsV319Test-Group-394243501: creating
Apr 24 20:01:51 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0f5bdd5b-beb1-4529-b9ff-f4104b5edc42 tempest-GroupSnapshotsV319Test-1065350276 None] Group tempest-GroupSnapshotsV319Test-Group-394243501: created successfully
Apr 24 20:01:51 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0f5bdd5b-beb1-4529-b9ff-f4104b5edc42 tempest-GroupSnapshotsV319Test-1065350276 None] Create group completed successfully.
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Flow 'volume_create_manager' (435ea5f5-56fd-4a2e-af8c-33c4203352cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78326e6-163e-415c-b0db-c15edd64aac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78326e6-163e-415c-b0db-c15edd64aac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-812231399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b52c614a-a3c4-4f72-9c01-30ae4b4d18e0,host='devstack@QuobyteHD#QuobyteHD',id=ebb0ae79-f022-48b9-b394-df559dd6ce38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003dde73f8524710b288227f017fc142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:53Z,use_quota=True,user_id='e6c5a44ca7174224b02104f5d4d4e42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c563e5f2-1a84-4c56-afa3-0452e0df63b1),volume_type_id=c563e5f2-1a84-4c56-afa3-0452e0df63b1)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b10be5-2f62-4e40-9c96-d9381ce2ab3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b10be5-2f62-4e40-9c96-d9381ce2ab3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a266f0-bb77-4f75-9b61-e4abbdb47138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a266f0-bb77-4f75-9b61-e4abbdb47138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebb0ae79-f022-48b9-b394-df559dd6ce38', 'volume_name': 'volume-ebb0ae79-f022-48b9-b394-df559dd6ce38', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727f35c6-34dc-488a-9186-39a56fa799b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727f35c6-34dc-488a-9186-39a56fa799b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0689418a-d68a-4963-a047-a1657fd6b75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:53 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Volume ebb0ae79-f022-48b9-b394-df559dd6ce38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebb0ae79-f022-48b9-b394-df559dd6ce38', 'volume_size': 1}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b52c614a-a3c4-4f72-9c01-30ae4b4d18e0,created_at=2026-04-24T18:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-812231399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b52c614a-a3c4-4f72-9c01-30ae4b4d18e0,host='devstack@QuobyteHD#QuobyteHD',id=ebb0ae79-f022-48b9-b394-df559dd6ce38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003dde73f8524710b288227f017fc142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:53Z,use_quota=True,user_id='e6c5a44ca7174224b02104f5d4d4e42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c563e5f2-1a84-4c56-afa3-0452e0df63b1),volume_type_id=c563e5f2-1a84-4c56-afa3-0452e0df63b1)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Creating volume ebb0ae79-f022-48b9-b394-df559dd6ce38 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:01:53 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:53 devstack sudo[88714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38 1073741824
Apr 24 20:01:53 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:53 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38 1073741824" returned: 0 in 0.665s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:54 devstack sudo[88719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38
Apr 24 20:01:54 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:54 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38" returned: 0 in 0.483s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:01:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0689418a-d68a-4963-a047-a1657fd6b75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb0ae79-f022-48b9-b394-df559dd6ce38', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abc57fb-c279-4413-827c-863918e5fa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:54 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Volume volume-ebb0ae79-f022-48b9-b394-df559dd6ce38 (ebb0ae79-f022-48b9-b394-df559dd6ce38): created successfully
Apr 24 20:01:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abc57fb-c279-4413-827c-863918e5fa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Flow 'volume_create_manager' (435ea5f5-56fd-4a2e-af8c-33c4203352cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:01:54 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-47c65cc1-77e3-4b62-adef-173c84bc24b0 tempest-GroupSnapshotsV319Test-1065350276 None] Created volume successfully.
Apr 24 20:01:55 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] GroupSnapshot d885c290-5d35-4068-b5ee-0ab1edb99c79: creating.
Apr 24 20:01:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] Group snapshot d885c290-5d35-4068-b5ee-0ab1edb99c79: creating. {{(pid=81241) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 24 20:01:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] Creating offline snapshot 1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add of volume ebb0ae79-f022-48b9-b394-df559dd6ce38 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:01:55 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda0b7c7-cbd7-4297-a35b-5ba26573c7e4]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:55 devstack sudo[88722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38
Apr 24 20:01:55 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Flow 'volume_create_manager' (7e721d13-3ed2-4853-b96c-a7c758fa1d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efc0c83-b414-4153-88f2-c04ddaef629e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efc0c83-b414-4153-88f2-c04ddaef629e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1182088671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f835642c-1694-46ff-81fe-61b869ac2e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a85a19dd94520aa9c58c3c23d8eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:56Z,use_quota=True,user_id='b94229c6bde746ceb29176a5f1b52ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58720f61-8287-4bb4-b1a5-79c111c8331d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58720f61-8287-4bb4-b1a5-79c111c8331d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbac92c-a135-417b-a414-55d946ea3b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbac92c-a135-417b-a414-55d946ea3b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f835642c-1694-46ff-81fe-61b869ac2e1b', 'volume_name': 'volume-f835642c-1694-46ff-81fe-61b869ac2e1b', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a135397-35a4-4536-86bd-381ffd64a2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a135397-35a4-4536-86bd-381ffd64a2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc15b25d-cd55-4622-8f11-e6d2c13d9dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:56 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Volume f835642c-1694-46ff-81fe-61b869ac2e1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f835642c-1694-46ff-81fe-61b869ac2e1b', 'volume_size': 1}
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:56 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38" returned: 0 in 0.549s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:56 devstack sudo[88727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add 1G
Apr 24 20:01:56 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:56 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add 1G" returned: 0 in 0.571s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb0ae79-f022-48b9-b394-df559dd6ce38 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:56 devstack sudo[88732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb0ae79-f022-48b9-b394-df559dd6ce38 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add
Apr 24 20:01:56 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:57 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb0ae79-f022-48b9-b394-df559dd6ce38 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add" returned: 0 in 0.469s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:57 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 20:01:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:57 devstack sudo[88737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add
Apr 24 20:01:57 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:57 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add" returned: 0 in 0.432s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:57 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.info
Apr 24 20:01:57 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:58 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.info" returned: 0 in 0.420s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:58 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 20:01:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:58 devstack sudo[88743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.info
Apr 24 20:01:58 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:58 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.info" returned: 0 in 0.426s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.951s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.523s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1182088671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f835642c-1694-46ff-81fe-61b869ac2e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a85a19dd94520aa9c58c3c23d8eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:56Z,use_quota=True,user_id='b94229c6bde746ceb29176a5f1b52ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:01:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Creating volume f835642c-1694-46ff-81fe-61b869ac2e1b {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:01:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:01:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:01:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:01:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:01:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:01:58 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:01:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:58 devstack sudo[88746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b 1073741824
Apr 24 20:01:58 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:58 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a70ebb0b-3503-4c5c-a8dd-278fa0facfc7 tempest-GroupSnapshotsV319Test-1065350276 None] group_snapshot d885c290-5d35-4068-b5ee-0ab1edb99c79: created successfully
Apr 24 20:01:59 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] group_snapshot d885c290-5d35-4068-b5ee-0ab1edb99c79: deleting
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] group_snapshot d885c290-5d35-4068-b5ee-0ab1edb99c79: deleting {{(pid=81241) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Acquiring lock "cinder-quobyte-ebb0ae79-f022-48b9-b394-df559dd6ce38" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Lock "cinder-quobyte-ebb0ae79-f022-48b9-b394-df559dd6ce38" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Acquiring lock "cinder-quobyte-1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Lock "cinder-quobyte-1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Deleting offline snapshot 1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add of volume ebb0ae79-f022-48b9-b394-df559dd6ce38 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] snapshot_file for this snap is: volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bf1172-0d43-432b-a826-26ebe22cc109]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:59 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b 1073741824" returned: 0 in 0.739s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:01:59 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b
Apr 24 20:01:59 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:59 devstack sudo[88752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add
Apr 24 20:01:59 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:01:59 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b" returned: 0 in 0.451s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc15b25d-cd55-4622-8f11-e6d2c13d9dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f835642c-1694-46ff-81fe-61b869ac2e1b', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b08b143-56c5-46fd-b745-09f13d64e416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:01:59 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Volume volume-f835642c-1694-46ff-81fe-61b869ac2e1b (f835642c-1694-46ff-81fe-61b869ac2e1b): created successfully
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b08b143-56c5-46fd-b745-09f13d64e416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:01:59 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Flow 'volume_create_manager' (7e721d13-3ed2-4853-b96c-a7c758fa1d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add" returned: 0 in 0.558s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebb0ae79-f022-48b9-b394-df559dd6ce38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:01:59 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-6f27206c-94bc-4ec5-9792-9884d98b3444 tempest-VolumesSnapshotTestJSON-1449875413 None] Created volume successfully.
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5479e5-15ea-4ae3-812b-5a40c4067ea1]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:01:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:00 devstack sudo[88760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38
Apr 24 20:02:00 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:00 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38" returned: 0 in 0.592s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:00 devstack sudo[88765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add
Apr 24 20:02:00 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:00 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] Creating offline snapshot f442b34d-0bb0-4b97-87eb-6d80149b1da4 of volume f835642c-1694-46ff-81fe-61b869ac2e1b {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:02:00 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fa330e-369e-440d-a72d-4b4f0ef10df0]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:00 devstack sudo[88767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b
Apr 24 20:02:00 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:01 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add" returned: 0 in 0.560s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:01 devstack sudo[88775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add
Apr 24 20:02:01 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:01 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b" returned: 0 in 0.611s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:01 devstack sudo[88777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4 1G
Apr 24 20:02:01 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:01 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38.1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add" returned: 0 in 0.454s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:01 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Lock "cinder-quobyte-1f8d0d4d-7aa1-43b4-a6e7-b99844ff8add" released by "_delete_snapshot" :: held 2.278s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:01 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Lock "cinder-quobyte-ebb0ae79-f022-48b9-b394-df559dd6ce38" released by "delete_snapshot" :: held 2.306s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:01 devstack cinder-volume[81241]: WARNING cinder.quota [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1954941392 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1954941392, it is now deprecated. Please use the default quota class for default quota.
Apr 24 20:02:01 devstack cinder-volume[81241]: WARNING cinder.quota [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1954941392 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1954941392, it is now deprecated. Please use the default quota class for default quota.
Apr 24 20:02:01 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] Created reservations ['0317c489-1879-4011-9d77-131085b77f02', '00e4d028-2179-4fea-8b55-41f140a9928c', '3c2533d6-192e-4164-b3f9-ae3dc6a72a15', 'a64fe084-ca14-4b64-93e7-2d67d1cac893'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:01 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d9720423-7df9-4214-aace-1c00b810cfec tempest-GroupSnapshotsV319Test-1065350276 None] group_snapshot d885c290-5d35-4068-b5ee-0ab1edb99c79: deleted successfully
Apr 24 20:02:01 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4 1G" returned: 0 in 0.641s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f835642c-1694-46ff-81fe-61b869ac2e1b -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:01 devstack sudo[88783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f835642c-1694-46ff-81fe-61b869ac2e1b -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4
Apr 24 20:02:01 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:02 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f835642c-1694-46ff-81fe-61b869ac2e1b -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4" returned: 0 in 0.476s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:02 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4 is being set with open permissions: ugo+rw
Apr 24 20:02:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:02 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4
Apr 24 20:02:02 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Acquiring lock "cinder-quobyte-ebb0ae79-f022-48b9-b394-df559dd6ce38" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Lock "cinder-quobyte-ebb0ae79-f022-48b9-b394-df559dd6ce38" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:02 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d5df06-2be8-47bc-a554-a4e06bd2d289]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:02 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4" returned: 0 in 0.479s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:02 devstack sudo[88791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38
Apr 24 20:02:02 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:02 devstack sudo[88792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.info
Apr 24 20:02:02 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:03 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.info" returned: 0 in 0.446s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:03 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.info is being set with open permissions: ugo+rw
Apr 24 20:02:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:03 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38" returned: 0 in 0.529s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:03 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.info
Apr 24 20:02:03 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:03 devstack sudo[88800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38
Apr 24 20:02:03 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:03 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.info" returned: 0 in 0.424s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:03 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.162s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ebb0ae79-f022-48b9-b394-df559dd6ce38" returned: 0 in 0.432s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Lock "cinder-quobyte-ebb0ae79-f022-48b9-b394-df559dd6ce38" released by "delete_volume" :: held 1.029s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:03 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-9dbdface-0ce5-4423-a597-5011adecaf7b tempest-VolumesSnapshotTestJSON-1449875413 None] Create snapshot completed successfully
Apr 24 20:02:03 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Created reservations ['9efd8c37-9084-497a-bebd-47c002d96148'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:03 devstack cinder-volume[81241]: WARNING cinder.quota [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1954941392 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1954941392, it is now deprecated. Please use the default quota class for default quota.
Apr 24 20:02:03 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Created reservations ['822d8012-a7d7-4201-be99-e996c0c45328', '88d48eb4-22ce-4a01-876f-03993054df1a', 'f86f752f-57a0-46d1-9c96-4c0d79121e8f', '39406d37-f486-4880-8323-3c6ba9636a07'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:04 devstack sudo[88805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:02:04 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:04 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.416s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:02:04 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-582fe3ca-3b39-4ccb-8439-5669c031c7b0 tempest-GroupSnapshotsV319Test-1065350276 None] Delete group completed successfully.
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-f442b34d-0bb0-4b97-87eb-6d80149b1da4-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-f442b34d-0bb0-4b97-87eb-6d80149b1da4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-f835642c-1694-46ff-81fe-61b869ac2e1b" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-f835642c-1694-46ff-81fe-61b869ac2e1b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-f442b34d-0bb0-4b97-87eb-6d80149b1da4" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-f442b34d-0bb0-4b97-87eb-6d80149b1da4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Deleting offline snapshot f442b34d-0bb0-4b97-87eb-6d80149b1da4 of volume f835642c-1694-46ff-81fe-61b869ac2e1b {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] snapshot_file for this snap is: volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb0af7f-181f-4413-84b2-e9591770020f]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:05 devstack sudo[88808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4
Apr 24 20:02:05 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:05 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4" returned: 0 in 0.554s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f835642c-1694-46ff-81fe-61b869ac2e1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:02:05 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3f59a5-da73-43c0-a76e-3d4f760d1e0e]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:05 devstack sudo[88813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b
Apr 24 20:02:05 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:06 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b" returned: 0 in 0.637s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:06 devstack sudo[88818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4
Apr 24 20:02:06 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:06 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4" returned: 0 in 0.605s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:06 devstack sudo[88823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4
Apr 24 20:02:06 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:07 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b.f442b34d-0bb0-4b97-87eb-6d80149b1da4" returned: 0 in 0.497s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-f442b34d-0bb0-4b97-87eb-6d80149b1da4" released by "_delete_snapshot" :: held 2.409s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-f835642c-1694-46ff-81fe-61b869ac2e1b" released by "delete_snapshot" :: held 2.432s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:07 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Created reservations ['114908e7-fcfe-4fd8-b8c9-fb867468ad28', 'bd15fe99-187e-4dea-8db7-4c9cd0a19a42', 'd07b7c48-be9e-4218-bfb9-d13f2be6b64a', '6d5c88c7-4cc6-4a56-8c6d-8848b2205216'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:07 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Delete snapshot completed successfully.
Apr 24 20:02:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d8701e0-12da-4178-a078-6a91e59dccc5 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-f442b34d-0bb0-4b97-87eb-6d80149b1da4-delete_snapshot" released by "delete_snapshot" :: held 2.625s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Flow 'volume_create_manager' (25994f6b-f8ae-4a0c-aa61-5d6cdc656c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39e16a5-1722-4890-b2c9-69ac2c4d4dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39e16a5-1722-4890-b2c9-69ac2c4d4dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1337331481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107697ef-acff-4d96-92a9-5dcf835ddefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a85a19dd94520aa9c58c3c23d8eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:08Z,use_quota=True,user_id='b94229c6bde746ceb29176a5f1b52ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ac5359-885b-4cd5-8aac-06a5ba29f9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ac5359-885b-4cd5-8aac-06a5ba29f9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbf404f-72b6-4982-b98a-624c3d744a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbf404f-72b6-4982-b98a-624c3d744a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '107697ef-acff-4d96-92a9-5dcf835ddefc', 'volume_name': 'volume-107697ef-acff-4d96-92a9-5dcf835ddefc', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5804fc05-71ed-44f0-894e-f46d4b0cba0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5804fc05-71ed-44f0-894e-f46d4b0cba0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4ad0fa-87b3-46ba-9f19-7805083a872c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:08 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Volume 107697ef-acff-4d96-92a9-5dcf835ddefc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-107697ef-acff-4d96-92a9-5dcf835ddefc', 'volume_size': 1}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1337331481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107697ef-acff-4d96-92a9-5dcf835ddefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a85a19dd94520aa9c58c3c23d8eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:08Z,use_quota=True,user_id='b94229c6bde746ceb29176a5f1b52ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Creating volume 107697ef-acff-4d96-92a9-5dcf835ddefc {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:02:08 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:02:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:08 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc 1073741824
Apr 24 20:02:08 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:09 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc 1073741824" returned: 0 in 0.652s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:09 devstack sudo[88831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc
Apr 24 20:02:09 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:09 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc" returned: 0 in 0.437s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:02:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:09 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-6c786767-36a3-4da3-82ac-94f902c50d30 tempest-GroupsV320Test-2116292318 None] Group tempest-GroupsV320Test-Group-413495388: creating
Apr 24 20:02:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4ad0fa-87b3-46ba-9f19-7805083a872c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107697ef-acff-4d96-92a9-5dcf835ddefc', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516e1665-fad3-4f84-addd-6f0efc9cbe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:09 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-6c786767-36a3-4da3-82ac-94f902c50d30 tempest-GroupsV320Test-2116292318 None] Group tempest-GroupsV320Test-Group-413495388: created successfully
Apr 24 20:02:09 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Volume volume-107697ef-acff-4d96-92a9-5dcf835ddefc (107697ef-acff-4d96-92a9-5dcf835ddefc): created successfully
Apr 24 20:02:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516e1665-fad3-4f84-addd-6f0efc9cbe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Flow 'volume_create_manager' (25994f6b-f8ae-4a0c-aa61-5d6cdc656c21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:02:09 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-6c786767-36a3-4da3-82ac-94f902c50d30 tempest-GroupsV320Test-2116292318 None] Create group completed successfully.
Apr 24 20:02:09 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b8681073-a12a-4b92-a8d4-2d8ee5426f84 tempest-VolumesSnapshotTestJSON-1449875413 None] Created volume successfully.
Apr 24 20:02:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:10 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] Creating offline snapshot 7347201a-af3f-41c3-90ef-734e8084c8e4 of volume 107697ef-acff-4d96-92a9-5dcf835ddefc {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:02:10 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d46fe8a-3128-4206-b7aa-d44d14b8e982]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:10 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc
Apr 24 20:02:10 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:11 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-2cb38f98-19ef-4de3-86eb-87ae82fad6fc tempest-GroupsV320Test-2116292318 None] Created reservations ['6d499e39-2af2-403e-9241-32c6a40d16a6'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2cb38f98-19ef-4de3-86eb-87ae82fad6fc tempest-GroupsV320Test-2116292318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2cb38f98-19ef-4de3-86eb-87ae82fad6fc tempest-GroupsV320Test-2116292318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:11 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-2cb38f98-19ef-4de3-86eb-87ae82fad6fc tempest-GroupsV320Test-2116292318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:11 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-2cb38f98-19ef-4de3-86eb-87ae82fad6fc tempest-GroupsV320Test-2116292318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2cb38f98-19ef-4de3-86eb-87ae82fad6fc tempest-GroupsV320Test-2116292318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2cb38f98-19ef-4de3-86eb-87ae82fad6fc tempest-GroupsV320Test-2116292318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:11 devstack sudo[88839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:02:11 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:11 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc" returned: 0 in 0.574s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:11 devstack sudo[88842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4 1G
Apr 24 20:02:11 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:11 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2cb38f98-19ef-4de3-86eb-87ae82fad6fc tempest-GroupsV320Test-2116292318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.500s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:11 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-2cb38f98-19ef-4de3-86eb-87ae82fad6fc tempest-GroupsV320Test-2116292318 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:02:11 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-2cb38f98-19ef-4de3-86eb-87ae82fad6fc tempest-GroupsV320Test-2116292318 None] Delete group completed successfully.
Apr 24 20:02:11 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4 1G" returned: 0 in 0.617s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107697ef-acff-4d96-92a9-5dcf835ddefc -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:12 devstack sudo[88848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107697ef-acff-4d96-92a9-5dcf835ddefc -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4
Apr 24 20:02:12 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:12 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107697ef-acff-4d96-92a9-5dcf835ddefc -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4" returned: 0 in 0.540s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:12 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4 is being set with open permissions: ugo+rw
Apr 24 20:02:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:12 devstack sudo[88853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4
Apr 24 20:02:12 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:13 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4" returned: 0 in 0.505s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:13 devstack sudo[88856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.info
Apr 24 20:02:13 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:13 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.info" returned: 0 in 0.555s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:13 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.info is being set with open permissions: ugo+rw
Apr 24 20:02:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:13 devstack sudo[88860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.info
Apr 24 20:02:13 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:14 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.info" returned: 0 in 0.564s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.448s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:14 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-28f7b990-2a7b-4fa3-9562-a3bf40402678 tempest-VolumesSnapshotTestJSON-1449875413 None] Create snapshot completed successfully
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Flow 'volume_create_manager' (523014a5-d131-43f6-bc5b-fea2a9f75f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6889de7-d5ea-4847-840d-9b8f2df8395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6889de7-d5ea-4847-840d-9b8f2df8395a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1653971051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba84938-b460-4b47-912b-31d861281eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a85a19dd94520aa9c58c3c23d8eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7347201a-af3f-41c3-90ef-734e8084c8e4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:15Z,use_quota=True,user_id='b94229c6bde746ceb29176a5f1b52ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471bc747-7ba3-4f91-a15c-5e30f1a6c978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471bc747-7ba3-4f91-a15c-5e30f1a6c978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260130a6-902d-4a1d-868c-68d79753f2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260130a6-902d-4a1d-868c-68d79753f2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ba84938-b460-4b47-912b-31d861281eb6', 'volume_name': 'volume-3ba84938-b460-4b47-912b-31d861281eb6', 'volume_size': 2, 'snapshot_id': '7347201a-af3f-41c3-90ef-734e8084c8e4'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984474f0-78f3-4c46-b5b0-06d8771d25d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984474f0-78f3-4c46-b5b0-06d8771d25d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960336ab-98be-4295-92c2-aabd1d756886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:15 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Volume 3ba84938-b460-4b47-912b-31d861281eb6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ba84938-b460-4b47-912b-31d861281eb6', 'volume_size': 2, 'snapshot_id': '7347201a-af3f-41c3-90ef-734e8084c8e4'}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-7347201a-af3f-41c3-90ef-734e8084c8e4-3ba84938-b460-4b47-912b-31d861281eb6" by "_create_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-7347201a-af3f-41c3-90ef-734e8084c8e4-3ba84938-b460-4b47-912b-31d861281eb6" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Creating volume 3ba84938-b460-4b47-912b-31d861281eb6 from snapshot 7347201a-af3f-41c3-90ef-734e8084c8e4 {{(pid=81241) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-3ba84938-b460-4b47-912b-31d861281eb6" by "_copy_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-3ba84938-b460-4b47-912b-31d861281eb6" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] snapshot: 7347201a-af3f-41c3-90ef-734e8084c8e4, volume: 3ba84938-b460-4b47-912b-31d861281eb6,  {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6389fb9d-d6bb-4779-8a12-d18d17d1edbc]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:15 devstack sudo[88865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4
Apr 24 20:02:15 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:16 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4" returned: 0 in 0.611s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107697ef-acff-4d96-92a9-5dcf835ddefc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:02:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 20:02:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Creating direct copy from snapshot {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 20:02:16 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83b3a5f-821d-40a2-ab6b-4f714ec155ce]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:16 devstack sudo[88870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc
Apr 24 20:02:16 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:16 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc" returned: 0 in 0.606s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:16 devstack cinder-volume[81241]: DEBUG cinder.utils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Path /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6 not found in is_blk_device check {{(pid=81241) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 20:02:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:16 devstack sudo[88875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6
Apr 24 20:02:16 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:21 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6" returned: 0 in 5.049s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:21 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbf4c08-b4f4-4c76-9707-393a9f33b1ba]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:22 devstack sudo[88894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc
Apr 24 20:02:22 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:22 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc" returned: 0 in 0.684s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:22 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6 {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 20:02:22 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Converted 1024.00 MB image at 202.76 MB/s
Apr 24 20:02:22 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6 is being set with open permissions: ugo+rw
Apr 24 20:02:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:22 devstack sudo[88901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6
Apr 24 20:02:22 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:23 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6" returned: 0 in 0.502s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-3ba84938-b460-4b47-912b-31d861281eb6" released by "_copy_volume_from_snapshot" :: held 7.537s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-7347201a-af3f-41c3-90ef-734e8084c8e4-3ba84938-b460-4b47-912b-31d861281eb6" released by "_create_volume_from_snapshot" :: held 7.573s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.592s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960336ab-98be-4295-92c2-aabd1d756886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba84938-b460-4b47-912b-31d861281eb6', 'volume_size': 2, 'snapshot_id': '7347201a-af3f-41c3-90ef-734e8084c8e4'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c9a5d6-8b8a-4bfd-a3a4-fd5b0b96a988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:23 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Volume volume-3ba84938-b460-4b47-912b-31d861281eb6 (3ba84938-b460-4b47-912b-31d861281eb6): created successfully
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c9a5d6-8b8a-4bfd-a3a4-fd5b0b96a988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Flow 'volume_create_manager' (523014a5-d131-43f6-bc5b-fea2a9f75f20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:02:23 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f0a98948-bd38-4229-a2e8-09b9b5b4be11 tempest-VolumesSnapshotTestJSON-1449875413 None] Created volume successfully.
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:24 devstack sudo[88904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:02:24 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-3ba84938-b460-4b47-912b-31d861281eb6-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-3ba84938-b460-4b47-912b-31d861281eb6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-3ba84938-b460-4b47-912b-31d861281eb6" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-3ba84938-b460-4b47-912b-31d861281eb6" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:24 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[552a2bcd-cf31-4b41-85fe-27fefc070e54]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:24 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6
Apr 24 20:02:24 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:24 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.489s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:24 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:02:24 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6" returned: 0 in 0.570s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:24 devstack sudo[88912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6
Apr 24 20:02:24 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:25 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3ba84938-b460-4b47-912b-31d861281eb6" returned: 0 in 0.479s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-3ba84938-b460-4b47-912b-31d861281eb6" released by "delete_volume" :: held 1.101s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:25 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Created reservations ['1b3bc486-d1f4-4aa1-ac4e-17518c7b40a7', '35cc4678-79e0-4ad7-9623-22a88a0ff814', 'a588c198-5c3d-41ad-a5ce-e29c33589b75', '2d491c3e-020a-4ea1-8d7b-8861b8062865'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:25 devstack sudo[88915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:02:25 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:25 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.454s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:25 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:02:26 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Deleted volume successfully.
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f519fb13-27e3-4d67-a4b3-ccc7eb622acd tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-3ba84938-b460-4b47-912b-31d861281eb6-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Flow 'volume_create_manager' (1ea8918c-f828-4ce3-81f2-e7ea3574a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b22d44c-1d8c-4435-831d-9ca228a97841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b22d44c-1d8c-4435-831d-9ca228a97841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1263125774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1c2724-1822-40d9-bae5-bda3132bfa43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d833e944664e4c36a41ad52775fdc963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:26Z,use_quota=True,user_id='93959096a89b4c8d83cdf7d454f40494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23990b4-3e9c-49f9-a479-a22bd3730507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23990b4-3e9c-49f9-a479-a22bd3730507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f7ceb2-019c-4683-b37e-778718cd395b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f7ceb2-019c-4683-b37e-778718cd395b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e1c2724-1822-40d9-bae5-bda3132bfa43', 'volume_name': 'volume-8e1c2724-1822-40d9-bae5-bda3132bfa43', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7970ba-9998-4509-b44a-1c189376179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7970ba-9998-4509-b44a-1c189376179c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea68eed0-354e-4173-8377-8ab040829fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:26 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Volume 8e1c2724-1822-40d9-bae5-bda3132bfa43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e1c2724-1822-40d9-bae5-bda3132bfa43', 'volume_size': 1}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1263125774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1c2724-1822-40d9-bae5-bda3132bfa43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d833e944664e4c36a41ad52775fdc963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:26Z,use_quota=True,user_id='93959096a89b4c8d83cdf7d454f40494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Creating volume 8e1c2724-1822-40d9-bae5-bda3132bfa43 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:02:26 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8e1c2724-1822-40d9-bae5-bda3132bfa43 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:26 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8e1c2724-1822-40d9-bae5-bda3132bfa43 1073741824
Apr 24 20:02:26 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-7347201a-af3f-41c3-90ef-734e8084c8e4-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-7347201a-af3f-41c3-90ef-734e8084c8e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-107697ef-acff-4d96-92a9-5dcf835ddefc" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-107697ef-acff-4d96-92a9-5dcf835ddefc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-7347201a-af3f-41c3-90ef-734e8084c8e4" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-7347201a-af3f-41c3-90ef-734e8084c8e4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Deleting offline snapshot 7347201a-af3f-41c3-90ef-734e8084c8e4 of volume 107697ef-acff-4d96-92a9-5dcf835ddefc {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] snapshot_file for this snap is: volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6293ef67-6d69-4cea-be01-12da2887a0a1]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:26 devstack sudo[88920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4
Apr 24 20:02:26 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:27 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8e1c2724-1822-40d9-bae5-bda3132bfa43 1073741824" returned: 0 in 0.638s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8e1c2724-1822-40d9-bae5-bda3132bfa43 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:27 devstack sudo[88928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8e1c2724-1822-40d9-bae5-bda3132bfa43
Apr 24 20:02:27 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:27 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4" returned: 0 in 0.534s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107697ef-acff-4d96-92a9-5dcf835ddefc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd05f3b-8fc8-48d2-94b8-75ca8f580b6e]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:27 devstack sudo[88930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc
Apr 24 20:02:27 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:27 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8e1c2724-1822-40d9-bae5-bda3132bfa43" returned: 0 in 0.442s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea68eed0-354e-4173-8377-8ab040829fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e1c2724-1822-40d9-bae5-bda3132bfa43', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c35a730-6dc4-4edf-aed2-4c4f1ec87d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:27 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Volume volume-8e1c2724-1822-40d9-bae5-bda3132bfa43 (8e1c2724-1822-40d9-bae5-bda3132bfa43): created successfully
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c35a730-6dc4-4edf-aed2-4c4f1ec87d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Flow 'volume_create_manager' (1ea8918c-f828-4ce3-81f2-e7ea3574a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:02:27 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a7771a58-3873-4d50-b7af-bd484e5104ca tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Created volume successfully.
Apr 24 20:02:27 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc" returned: 0 in 0.510s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:27 devstack sudo[88937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4
Apr 24 20:02:27 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:28 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4" returned: 0 in 0.519s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:28 devstack sudo[88942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4
Apr 24 20:02:28 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:28 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc.7347201a-af3f-41c3-90ef-734e8084c8e4" returned: 0 in 0.456s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-7347201a-af3f-41c3-90ef-734e8084c8e4" released by "_delete_snapshot" :: held 2.112s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-107697ef-acff-4d96-92a9-5dcf835ddefc" released by "delete_snapshot" :: held 2.136s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:28 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Created reservations ['312d4e97-8bf6-4668-871d-4851cb3fdf1d', '4a05df19-96b4-4219-b9eb-647d7a906abb', '25167303-5035-488c-9202-2fcd5434469c', '4d1f2b3c-09df-435f-bde4-02ca598ee759'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:28 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Delete snapshot completed successfully.
Apr 24 20:02:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-870bbe3b-1ca0-4a70-946d-86d1ec188acf tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-7347201a-af3f-41c3-90ef-734e8084c8e4-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Acquiring lock "cinder-8e1c2724-1822-40d9-bae5-bda3132bfa43-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Lock "cinder-8e1c2724-1822-40d9-bae5-bda3132bfa43-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Acquiring lock "cinder-quobyte-8e1c2724-1822-40d9-bae5-bda3132bfa43" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Lock "cinder-quobyte-8e1c2724-1822-40d9-bae5-bda3132bfa43" acquired by "delete_volume" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:29 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[50791ff8-882a-463f-b51a-b26ca87cdf52]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8e1c2724-1822-40d9-bae5-bda3132bfa43 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:29 devstack sudo[88946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8e1c2724-1822-40d9-bae5-bda3132bfa43
Apr 24 20:02:29 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-107697ef-acff-4d96-92a9-5dcf835ddefc-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-107697ef-acff-4d96-92a9-5dcf835ddefc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-107697ef-acff-4d96-92a9-5dcf835ddefc" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-107697ef-acff-4d96-92a9-5dcf835ddefc" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:29 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[da408c1c-45e5-47cf-bd80-e1acbfae88f2]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:29 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8e1c2724-1822-40d9-bae5-bda3132bfa43" returned: 0 in 0.547s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8e1c2724-1822-40d9-bae5-bda3132bfa43 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:29 devstack sudo[88952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8e1c2724-1822-40d9-bae5-bda3132bfa43
Apr 24 20:02:29 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:29 devstack sudo[88951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc
Apr 24 20:02:29 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:30 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-8e1c2724-1822-40d9-bae5-bda3132bfa43" returned: 0 in 0.448s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Lock "cinder-quobyte-8e1c2724-1822-40d9-bae5-bda3132bfa43" released by "delete_volume" :: held 1.033s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:30 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc" returned: 0 in 0.532s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Created reservations ['4683f424-58bb-49a3-ab97-0c09803e2957', 'f3b66139-ef52-4454-aebd-b89ed2c2f71c', '44f0616d-c5a0-4f86-97e7-c4e1712b5b64', 'd3b6db4d-e084-46b9-99b1-4dc9f73ac33e'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:30 devstack sudo[88959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc
Apr 24 20:02:30 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:30 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:02:30 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:30 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-107697ef-acff-4d96-92a9-5dcf835ddefc" returned: 0 in 0.448s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-107697ef-acff-4d96-92a9-5dcf835ddefc" released by "delete_volume" :: held 1.040s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Created reservations ['023a620b-aca4-4e4e-a0dc-e98fdb6438b2', '7fe2f089-47ef-4891-8f8c-7236ed85051b', 'b32d481f-e507-4ad4-a47f-fe70933eeea1', '8a174f33-52be-471c-9237-c6fa46f60651'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:30 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.444s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:02:30 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Deleted volume successfully.
Apr 24 20:02:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0bff9d2a-f8b5-4824-9234-4b790af47beb tempest-VolumeQuotasNegativeTestJSON-2126897465 None] Lock "cinder-8e1c2724-1822-40d9-bae5-bda3132bfa43-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:31 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:02:31 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:31 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.437s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:31 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:02:31 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Deleted volume successfully.
Apr 24 20:02:31 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f47edf38-de1e-49e7-8457-36f9e97c9eea tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-107697ef-acff-4d96-92a9-5dcf835ddefc-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Flow 'volume_create_manager' (bef0917c-7647-4d39-b317-ab3ce5947fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1add96-7b25-4f19-8657-893cbb585b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1add96-7b25-4f19-8657-893cbb585b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-599845434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929367de-f1f4-4c56-8481-a98c3cd89323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a85a19dd94520aa9c58c3c23d8eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:32Z,use_quota=True,user_id='b94229c6bde746ceb29176a5f1b52ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c74bde1-f62d-40dd-99e6-9de7131154cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c74bde1-f62d-40dd-99e6-9de7131154cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0dd1d99-3d08-490a-be3b-eab0fc3402e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0dd1d99-3d08-490a-be3b-eab0fc3402e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '929367de-f1f4-4c56-8481-a98c3cd89323', 'volume_name': 'volume-929367de-f1f4-4c56-8481-a98c3cd89323', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d803ea-7f07-4956-a61c-7571613946cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d803ea-7f07-4956-a61c-7571613946cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097a7251-ad68-4f25-b018-ff27f2f46af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:32 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Volume 929367de-f1f4-4c56-8481-a98c3cd89323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-929367de-f1f4-4c56-8481-a98c3cd89323', 'volume_size': 1}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-599845434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929367de-f1f4-4c56-8481-a98c3cd89323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a85a19dd94520aa9c58c3c23d8eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:32Z,use_quota=True,user_id='b94229c6bde746ceb29176a5f1b52ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Creating volume 929367de-f1f4-4c56-8481-a98c3cd89323 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:02:32 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:02:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:32 devstack sudo[88968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323 1073741824
Apr 24 20:02:32 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:33 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323 1073741824" returned: 0 in 0.654s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:33 devstack sudo[88973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323
Apr 24 20:02:33 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:33 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323" returned: 0 in 0.486s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:02:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097a7251-ad68-4f25-b018-ff27f2f46af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-929367de-f1f4-4c56-8481-a98c3cd89323', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af36bce9-cf3b-4056-bc4d-21ba6057bf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:33 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Volume volume-929367de-f1f4-4c56-8481-a98c3cd89323 (929367de-f1f4-4c56-8481-a98c3cd89323): created successfully
Apr 24 20:02:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af36bce9-cf3b-4056-bc4d-21ba6057bf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Flow 'volume_create_manager' (bef0917c-7647-4d39-b317-ab3ce5947fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:02:33 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-818d9013-6d3b-48a6-aaf8-56ba4bee6faf tempest-VolumesSnapshotTestJSON-1449875413 None] Created volume successfully.
Apr 24 20:02:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] Creating offline snapshot 761670ac-5a64-48e5-a7ef-2e1983f42364 of volume 929367de-f1f4-4c56-8481-a98c3cd89323 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:02:34 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee2c873-6c23-4073-a990-a84929482a96]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:34 devstack sudo[88976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323
Apr 24 20:02:34 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Flow 'volume_create_manager' (6b73b27c-c364-4032-982a-f6fc34b88449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d12de5c-bae3-4a70-bdba-93082a5ba62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d12de5c-bae3-4a70-bdba-93082a5ba62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-113305797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134a5f72-b5fe-4c17-abc4-311575c02323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d8cb4f4a36498494729014585023fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:35Z,use_quota=True,user_id='db2d0fa23cce46aabaa465790be17d7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d23997-1c7e-465b-a975-6e6b22e0b70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d23997-1c7e-465b-a975-6e6b22e0b70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee3fbb1-bc43-408c-9069-70467f0d5132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee3fbb1-bc43-408c-9069-70467f0d5132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '134a5f72-b5fe-4c17-abc4-311575c02323', 'volume_name': 'volume-134a5f72-b5fe-4c17-abc4-311575c02323', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa50c449-7408-4b60-95de-71937e4c2259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa50c449-7408-4b60-95de-71937e4c2259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e47257-d405-4705-86f8-1c7c520ddf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:35 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Volume 134a5f72-b5fe-4c17-abc4-311575c02323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-134a5f72-b5fe-4c17-abc4-311575c02323', 'volume_size': 1}
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:35 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323" returned: 0 in 0.582s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:35 devstack sudo[88981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364 1G
Apr 24 20:02:35 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:35 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364 1G" returned: 0 in 0.591s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929367de-f1f4-4c56-8481-a98c3cd89323 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:35 devstack sudo[88986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929367de-f1f4-4c56-8481-a98c3cd89323 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364
Apr 24 20:02:35 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:36 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-929367de-f1f4-4c56-8481-a98c3cd89323 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364" returned: 0 in 0.501s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:36 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364 is being set with open permissions: ugo+rw
Apr 24 20:02:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:36 devstack sudo[88991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364
Apr 24 20:02:36 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:36 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364" returned: 0 in 0.459s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:36 devstack sudo[88994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.info
Apr 24 20:02:36 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:37 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.info" returned: 0 in 0.450s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:37 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.info is being set with open permissions: ugo+rw
Apr 24 20:02:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:37 devstack sudo[88997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.info
Apr 24 20:02:37 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:37 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.info" returned: 0 in 0.428s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.111s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.573s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-113305797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134a5f72-b5fe-4c17-abc4-311575c02323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d8cb4f4a36498494729014585023fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:35Z,use_quota=True,user_id='db2d0fa23cce46aabaa465790be17d7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:02:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Creating volume 134a5f72-b5fe-4c17-abc4-311575c02323 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:02:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:02:37 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:02:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:37 devstack sudo[89000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323 1073741824
Apr 24 20:02:37 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:37 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c6e1df58-b376-47e3-a2fd-1a9f8b8104dd tempest-VolumesSnapshotTestJSON-1449875413 None] Create snapshot completed successfully
Apr 24 20:02:38 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323 1073741824" returned: 0 in 0.622s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:38 devstack sudo[89005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323
Apr 24 20:02:38 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:38 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323" returned: 0 in 0.432s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:02:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e47257-d405-4705-86f8-1c7c520ddf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-134a5f72-b5fe-4c17-abc4-311575c02323', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7649a792-61bc-433f-9553-fc01990cdb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:38 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Volume volume-134a5f72-b5fe-4c17-abc4-311575c02323 (134a5f72-b5fe-4c17-abc4-311575c02323): created successfully
Apr 24 20:02:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7649a792-61bc-433f-9553-fc01990cdb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Flow 'volume_create_manager' (6b73b27c-c364-4032-982a-f6fc34b88449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:02:38 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-9936a69e-878f-4de7-9138-7fb5151e9d8e tempest-VolumesDeleteCascade-1241881483 None] Created volume successfully.
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Flow 'volume_create_manager' (4c8aa167-0372-4551-bdc7-f0a5e61fe6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb52ddd-b5d9-4d96-866f-6ee5b519b13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb52ddd-b5d9-4d96-866f-6ee5b519b13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-289389126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f5d3e15-af50-426e-9d11-be8debbb6b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a85a19dd94520aa9c58c3c23d8eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=761670ac-5a64-48e5-a7ef-2e1983f42364,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:39Z,use_quota=True,user_id='b94229c6bde746ceb29176a5f1b52ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246474aa-4111-4394-95f8-0574acff7a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246474aa-4111-4394-95f8-0574acff7a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad06566d-eaf0-4159-a053-484b2ea7c3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad06566d-eaf0-4159-a053-484b2ea7c3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7f5d3e15-af50-426e-9d11-be8debbb6b9d', 'volume_name': 'volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d', 'volume_size': 1, 'snapshot_id': '761670ac-5a64-48e5-a7ef-2e1983f42364'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e0a2e1-fe98-4730-9b9c-3b9493b393b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e0a2e1-fe98-4730-9b9c-3b9493b393b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a26b36-165d-463d-bb0b-49f8e6c83e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:39 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Volume 7f5d3e15-af50-426e-9d11-be8debbb6b9d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d', 'volume_size': 1, 'snapshot_id': '761670ac-5a64-48e5-a7ef-2e1983f42364'}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-761670ac-5a64-48e5-a7ef-2e1983f42364-7f5d3e15-af50-426e-9d11-be8debbb6b9d" by "_create_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-761670ac-5a64-48e5-a7ef-2e1983f42364-7f5d3e15-af50-426e-9d11-be8debbb6b9d" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Creating volume 7f5d3e15-af50-426e-9d11-be8debbb6b9d from snapshot 761670ac-5a64-48e5-a7ef-2e1983f42364 {{(pid=81241) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-7f5d3e15-af50-426e-9d11-be8debbb6b9d" by "_copy_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-7f5d3e15-af50-426e-9d11-be8debbb6b9d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] snapshot: 761670ac-5a64-48e5-a7ef-2e1983f42364, volume: 7f5d3e15-af50-426e-9d11-be8debbb6b9d,  {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab229344-e279-4e5a-84a2-9625b584f78e]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:39 devstack sudo[89009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364
Apr 24 20:02:39 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:39 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364" returned: 0 in 0.528s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-929367de-f1f4-4c56-8481-a98c3cd89323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323 {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Creating direct copy from snapshot {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d667d90-af7c-46a6-aefd-8e9833a3ba13]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:40 devstack sudo[89014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323
Apr 24 20:02:40 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:40 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323" returned: 0 in 0.511s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:40 devstack cinder-volume[81241]: DEBUG cinder.utils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Path /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d not found in is_blk_device check {{(pid=81241) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 20:02:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:40 devstack sudo[89053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d
Apr 24 20:02:40 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:44 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d" returned: 0 in 4.318s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:44 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d056ae-9665-4e65-ba0f-9d2e2f7932a6]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:44 devstack sudo[89065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323
Apr 24 20:02:44 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:45 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323" returned: 0 in 0.625s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323, size 1024.00 MB, duration 4.32 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 20:02:45 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Converted 1024.00 MB image at 237.04 MB/s
Apr 24 20:02:45 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d is being set with open permissions: ugo+rw
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:45 devstack sudo[89070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d
Apr 24 20:02:45 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:45 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d" returned: 0 in 0.423s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-7f5d3e15-af50-426e-9d11-be8debbb6b9d" released by "_copy_volume_from_snapshot" :: held 6.505s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-761670ac-5a64-48e5-a7ef-2e1983f42364-7f5d3e15-af50-426e-9d11-be8debbb6b9d" released by "_create_volume_from_snapshot" :: held 6.535s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.552s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.320s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:UPDATE=102,cinder:SELECT=96,cinder:INSERT=20,cinder:DELETE=5 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=101,cinder:INSERT=25,cinder:UPDATE=88,cinder:DELETE=8 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] Creating offline snapshot c76fadb6-c468-4eb7-8201-d3739843f8d8 of volume 134a5f72-b5fe-4c17-abc4-311575c02323 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32cc3f0-f0b9-4e80-b443-c5c1aa2f3791]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a26b36-165d-463d-bb0b-49f8e6c83e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d', 'volume_size': 1, 'snapshot_id': '761670ac-5a64-48e5-a7ef-2e1983f42364'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbebac1d-8ad1-42a2-b9b1-60c2c0433c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:02:45 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Volume volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d (7f5d3e15-af50-426e-9d11-be8debbb6b9d): created successfully
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbebac1d-8ad1-42a2-b9b1-60c2c0433c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:02:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Flow 'volume_create_manager' (4c8aa167-0372-4551-bdc7-f0a5e61fe6e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:02:45 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-ca007bb3-4dd1-4914-8663-2c1b6ec24a26 tempest-VolumesSnapshotTestJSON-1449875413 None] Created volume successfully.
Apr 24 20:02:45 devstack sudo[89073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323
Apr 24 20:02:45 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:46 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323" returned: 0 in 0.516s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:46 devstack sudo[89078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 1G
Apr 24 20:02:46 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-7f5d3e15-af50-426e-9d11-be8debbb6b9d-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:47 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-7f5d3e15-af50-426e-9d11-be8debbb6b9d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:47 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 1G" returned: 0 in 0.603s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-134a5f72-b5fe-4c17-abc4-311575c02323 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:47 devstack sudo[89083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-134a5f72-b5fe-4c17-abc4-311575c02323 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8
Apr 24 20:02:47 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:47 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-7f5d3e15-af50-426e-9d11-be8debbb6b9d" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:47 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-7f5d3e15-af50-426e-9d11-be8debbb6b9d" acquired by "delete_volume" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:47 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba86806-5644-4da0-b45c-95da82c900c3]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:47 devstack sudo[89085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d
Apr 24 20:02:47 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:47 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-134a5f72-b5fe-4c17-abc4-311575c02323 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8" returned: 0 in 0.508s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:47 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 is being set with open permissions: ugo+rw
Apr 24 20:02:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:47 devstack sudo[89093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8
Apr 24 20:02:47 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:47 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d" returned: 0 in 0.528s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:47 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d
Apr 24 20:02:47 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:47 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8" returned: 0 in 0.432s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:48 devstack sudo[89099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.info
Apr 24 20:02:48 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:48 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7f5d3e15-af50-426e-9d11-be8debbb6b9d" returned: 0 in 0.453s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-7f5d3e15-af50-426e-9d11-be8debbb6b9d" released by "delete_volume" :: held 1.017s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Created reservations ['6d26f052-61d3-4585-bfb5-bcc4ea3d3525', '5c5bb8a2-68a4-46c1-a937-41fadfa91707', '565e1a5b-ba2e-419d-bd60-57a4c70eb72a', '4274fba0-5799-4016-9ec5-2ba84d68e4ec'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:48 devstack sudo[89101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:02:48 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:48 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.info" returned: 0 in 0.443s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:48 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.info is being set with open permissions: ugo+rw
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:48 devstack sudo[89104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.info
Apr 24 20:02:48 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:48 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.414s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:02:48 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Deleted volume successfully.
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bbdaeab7-87da-4954-bd72-206bb1a8195a tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-7f5d3e15-af50-426e-9d11-be8debbb6b9d-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:48 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.info" returned: 0 in 0.452s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.047s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:48 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a5c5b4d7-1b6b-4b08-ab6f-27cbd92f5077 tempest-VolumesDeleteCascade-1241881483 None] Create snapshot completed successfully
Apr 24 20:02:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-761670ac-5a64-48e5-a7ef-2e1983f42364-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-761670ac-5a64-48e5-a7ef-2e1983f42364-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-929367de-f1f4-4c56-8481-a98c3cd89323" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-929367de-f1f4-4c56-8481-a98c3cd89323" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-761670ac-5a64-48e5-a7ef-2e1983f42364" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-761670ac-5a64-48e5-a7ef-2e1983f42364" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Deleting offline snapshot 761670ac-5a64-48e5-a7ef-2e1983f42364 of volume 929367de-f1f4-4c56-8481-a98c3cd89323 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:02:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] snapshot_file for this snap is: volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:02:49 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfe1be4-b9b8-4302-a12d-805dd8614628]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:49 devstack sudo[89109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364
Apr 24 20:02:49 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:49 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364" returned: 0 in 0.516s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-929367de-f1f4-4c56-8481-a98c3cd89323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:02:49 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35a4e7c-5910-4dbc-b876-fc60813ea0da]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:49 devstack sudo[89114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323
Apr 24 20:02:49 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] Creating offline snapshot 4b446dbc-4ecc-447c-9d9a-a071fcc11985 of volume 134a5f72-b5fe-4c17-abc4-311575c02323 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:02:50 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4f864e-5a55-49d1-9fce-b1a73d0bbccf]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:50 devstack sudo[89116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8
Apr 24 20:02:50 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:50 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323" returned: 0 in 0.591s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:50 devstack sudo[89121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364
Apr 24 20:02:50 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:50 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8" returned: 0 in 0.540s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-134a5f72-b5fe-4c17-abc4-311575c02323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:02:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:50 devstack sudo[89126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985 1G
Apr 24 20:02:50 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:51 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364" returned: 0 in 0.540s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:51 devstack sudo[89131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364
Apr 24 20:02:51 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:51 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985 1G" returned: 0 in 0.698s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:51 devstack sudo[89137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985
Apr 24 20:02:51 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:51 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323.761670ac-5a64-48e5-a7ef-2e1983f42364" returned: 0 in 0.497s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:51 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-761670ac-5a64-48e5-a7ef-2e1983f42364" released by "_delete_snapshot" :: held 2.248s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:51 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-929367de-f1f4-4c56-8481-a98c3cd89323" released by "delete_snapshot" :: held 2.272s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:51 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Created reservations ['bd18320d-7c2c-4aef-8bc5-02822d62f79e', '1d34a41f-6cfb-4f6f-a446-2b509db3def9', 'd2132a66-ef7f-4d6e-af62-a88d7ef7f8f8', 'd077cdcc-bec2-4f28-bebe-ef883d8e4662'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:51 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Delete snapshot completed successfully.
Apr 24 20:02:51 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-51d93c96-c1f0-466d-acbc-e038e02cdb52 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-761670ac-5a64-48e5-a7ef-2e1983f42364-delete_snapshot" released by "delete_snapshot" :: held 2.406s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:51 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985" returned: 0 in 0.508s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:51 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985 is being set with open permissions: ugo+rw
Apr 24 20:02:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:51 devstack sudo[89142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985
Apr 24 20:02:51 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:52 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985" returned: 0 in 0.462s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.319s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:52 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-83a803bf-9110-4d47-a7b4-dc572f70a50b tempest-VolumesDeleteCascade-1241881483 None] Create snapshot completed successfully
Apr 24 20:02:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-929367de-f1f4-4c56-8481-a98c3cd89323-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-929367de-f1f4-4c56-8481-a98c3cd89323-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-929367de-f1f4-4c56-8481-a98c3cd89323" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-929367de-f1f4-4c56-8481-a98c3cd89323" acquired by "delete_volume" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:52 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9157091-afd6-41ac-aca4-985a140a9b71]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:52 devstack sudo[89145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323
Apr 24 20:02:52 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:53 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323" returned: 0 in 0.515s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:53 devstack sudo[89150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323
Apr 24 20:02:53 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-134a5f72-b5fe-4c17-abc4-311575c02323-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-134a5f72-b5fe-4c17-abc4-311575c02323-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Performing cascade delete. {{(pid=81241) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-4b446dbc-4ecc-447c-9d9a-a071fcc11985-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-4b446dbc-4ecc-447c-9d9a-a071fcc11985-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-quobyte-134a5f72-b5fe-4c17-abc4-311575c02323" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-134a5f72-b5fe-4c17-abc4-311575c02323" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-quobyte-4b446dbc-4ecc-447c-9d9a-a071fcc11985" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-4b446dbc-4ecc-447c-9d9a-a071fcc11985" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Deleting offline snapshot 4b446dbc-4ecc-447c-9d9a-a071fcc11985 of volume 134a5f72-b5fe-4c17-abc4-311575c02323 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] snapshot_file for this snap is: volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1302b5-4f5d-4815-8ada-48c74035078b]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:53 devstack sudo[89152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985
Apr 24 20:02:53 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:53 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-929367de-f1f4-4c56-8481-a98c3cd89323" returned: 0 in 0.476s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-929367de-f1f4-4c56-8481-a98c3cd89323" released by "delete_volume" :: held 1.047s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Created reservations ['bae3c3ea-ba70-486e-b2cf-5a984c14f60b', '57e1c61f-d845-4c8d-9375-f25e301cf3dd', '261eb2de-5f16-4b43-b940-31bbb1243322', '130ec4c0-fba5-4add-b078-86c6eed4e117'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:53 devstack sudo[89155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:02:53 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:54 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985" returned: 0 in 0.566s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-134a5f72-b5fe-4c17-abc4-311575c02323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d6e660-9b86-4ce5-a2ce-2a31e003e5e4]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:54 devstack sudo[89160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8
Apr 24 20:02:54 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:54 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.471s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:02:54 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Deleted volume successfully.
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3acb1edc-0a4e-47ab-863a-9c4b973be1eb tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-929367de-f1f4-4c56-8481-a98c3cd89323-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:54 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8" returned: 0 in 0.557s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-134a5f72-b5fe-4c17-abc4-311575c02323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:54 devstack sudo[89166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985
Apr 24 20:02:54 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-f835642c-1694-46ff-81fe-61b869ac2e1b-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-f835642c-1694-46ff-81fe-61b869ac2e1b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "cinder-quobyte-f835642c-1694-46ff-81fe-61b869ac2e1b" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-f835642c-1694-46ff-81fe-61b869ac2e1b" acquired by "delete_volume" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d46768-1b68-440c-84f7-34467f033640]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:54 devstack sudo[89168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b
Apr 24 20:02:54 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:55 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985" returned: 0 in 0.640s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:55 devstack sudo[89173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985
Apr 24 20:02:55 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:55 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b" returned: 0 in 0.556s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:55 devstack sudo[89178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b
Apr 24 20:02:55 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:55 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.4b446dbc-4ecc-447c-9d9a-a071fcc11985" returned: 0 in 0.470s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-4b446dbc-4ecc-447c-9d9a-a071fcc11985" released by "_delete_snapshot" :: held 2.326s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-134a5f72-b5fe-4c17-abc4-311575c02323" released by "delete_snapshot" :: held 2.352s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Created reservations ['41d9c9b1-5340-4135-a1ff-377da4fef8f8', 'c149c54d-a565-443e-93dd-87f7c3740301', 'c826e7d5-72ed-4f4a-b957-2b8398d6a3f0', '31898dff-af15-469b-8e86-5a6b5eab6d57'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:55 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Delete snapshot completed successfully.
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-4b446dbc-4ecc-447c-9d9a-a071fcc11985-delete_snapshot" released by "delete_snapshot" :: held 2.502s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-c76fadb6-c468-4eb7-8201-d3739843f8d8-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:55 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f835642c-1694-46ff-81fe-61b869ac2e1b" returned: 0 in 0.439s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-quobyte-f835642c-1694-46ff-81fe-61b869ac2e1b" released by "delete_volume" :: held 1.055s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-c76fadb6-c468-4eb7-8201-d3739843f8d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-quobyte-134a5f72-b5fe-4c17-abc4-311575c02323" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-134a5f72-b5fe-4c17-abc4-311575c02323" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-quobyte-c76fadb6-c468-4eb7-8201-d3739843f8d8" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-c76fadb6-c468-4eb7-8201-d3739843f8d8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Deleting offline snapshot c76fadb6-c468-4eb7-8201-d3739843f8d8 of volume 134a5f72-b5fe-4c17-abc4-311575c02323 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] snapshot_file for this snap is: volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4597289-06ab-48b9-b545-ac1e008ab584]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Created reservations ['67e5de2c-b8cb-410d-bbed-4cad9713e75b', 'a9c72240-805a-43a2-8c04-ff98304610ac', '478d2b89-e77d-4a2b-8950-27e9f5eebc97', 'fd67e8aa-4e0d-4845-b1ea-f1aba468aeb7'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:56 devstack sudo[89182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:56 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:56 devstack sudo[89184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:02:56 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:56 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:56 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.474s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:02:56 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Deleted volume successfully.
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8" returned: 0 in 0.609s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-134a5f72-b5fe-4c17-abc4-311575c02323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-652cf379-b878-45c5-832f-abcb88d65a08 tempest-VolumesSnapshotTestJSON-1449875413 None] Lock "cinder-f835642c-1694-46ff-81fe-61b869ac2e1b-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6d2487-1b02-4841-8c9e-3512211e743e]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:56 devstack sudo[89190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323
Apr 24 20:02:56 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:57 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323" returned: 0 in 0.522s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:57 devstack sudo[89195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8
Apr 24 20:02:57 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:57 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8" returned: 0 in 0.617s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:57 devstack sudo[89200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8
Apr 24 20:02:57 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:58 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323.c76fadb6-c468-4eb7-8201-d3739843f8d8" returned: 0 in 0.439s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-c76fadb6-c468-4eb7-8201-d3739843f8d8" released by "_delete_snapshot" :: held 2.287s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-134a5f72-b5fe-4c17-abc4-311575c02323" released by "delete_snapshot" :: held 2.314s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:58 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Created reservations ['22b86ce4-af9f-4c0f-86ce-63b7ce86f513', '710fd18f-7e4c-4297-aa77-69f35039bcda', '36f943f3-7ed8-4240-9c00-fbb580e0da93', '20da5f5c-af21-400b-8eb0-778917ff0239'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:58 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Delete snapshot completed successfully.
Apr 24 20:02:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-c76fadb6-c468-4eb7-8201-d3739843f8d8-delete_snapshot" released by "delete_snapshot" :: held 2.496s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:58 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Snapshots deleted, issuing volume delete {{(pid=81241) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 24 20:02:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-quobyte-134a5f72-b5fe-4c17-abc4-311575c02323" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:02:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-134a5f72-b5fe-4c17-abc4-311575c02323" acquired by "delete_volume" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:02:58 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d388106f-40d7-4e1d-9524-1ef3f4c732c1]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:02:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:58 devstack sudo[89204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323
Apr 24 20:02:58 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:59 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323" returned: 0 in 0.576s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:59 devstack sudo[89209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323
Apr 24 20:02:59 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:02:59 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root
Apr 24 20:02:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-134a5f72-b5fe-4c17-abc4-311575c02323" returned: 0 in 0.539s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:02:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-134a5f72-b5fe-4c17-abc4-311575c02323" released by "delete_volume" :: held 1.174s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:02:59 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Created reservations ['6d850a19-c931-49db-bbb0-4a486ad081a6', '27d4682e-653d-47ce-8a0c-bceae62f47ce', '140a9aae-2a0b-407b-b361-af7c9db36608', '511967bd-1a81-4d09-8cb4-8f43703f7019'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:02:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:02:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:02:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:02:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:02:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:02:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:02:59 devstack sudo[89213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:02:59 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:00 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.534s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:00 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:03:00 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Deleted volume successfully.
Apr 24 20:03:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1438d4a9-dd4c-4973-ae8c-b32b8e19a49f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-134a5f72-b5fe-4c17-abc4-311575c02323-delete_volume" released by "delete_volume" :: held 7.016s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Flow 'volume_create_manager' (18d592de-c80e-48ff-b940-2fe89cb10332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b35b8f-147c-44e4-a124-194edc7ec3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b35b8f-147c-44e4-a124-194edc7ec3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-928885854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c479e28-7c81-49b7-b259-78e984f49d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d8cb4f4a36498494729014585023fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:01Z,use_quota=True,user_id='db2d0fa23cce46aabaa465790be17d7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16447f1-d9c0-4038-b59d-d10792bdddec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16447f1-d9c0-4038-b59d-d10792bdddec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6eb9aa8-3510-4425-8a92-3f91dccf8803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6eb9aa8-3510-4425-8a92-3f91dccf8803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c479e28-7c81-49b7-b259-78e984f49d02', 'volume_name': 'volume-4c479e28-7c81-49b7-b259-78e984f49d02', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d521dff-f636-42a0-8427-0889fdd07124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d521dff-f636-42a0-8427-0889fdd07124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd52bc1-52c1-4af3-b24b-d2fe89960363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:01 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Volume 4c479e28-7c81-49b7-b259-78e984f49d02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c479e28-7c81-49b7-b259-78e984f49d02', 'volume_size': 1}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-928885854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c479e28-7c81-49b7-b259-78e984f49d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d8cb4f4a36498494729014585023fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:01Z,use_quota=True,user_id='db2d0fa23cce46aabaa465790be17d7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Creating volume 4c479e28-7c81-49b7-b259-78e984f49d02 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:03:01 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:03:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:01 devstack sudo[89217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02 1073741824
Apr 24 20:03:01 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:02 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02 1073741824" returned: 0 in 0.588s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:02 devstack sudo[89222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02
Apr 24 20:03:02 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:02 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02" returned: 0 in 0.425s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:03:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd52bc1-52c1-4af3-b24b-d2fe89960363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c479e28-7c81-49b7-b259-78e984f49d02', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb48eb51-b3c0-4962-ac66-44ff49456e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:02 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Volume volume-4c479e28-7c81-49b7-b259-78e984f49d02 (4c479e28-7c81-49b7-b259-78e984f49d02): created successfully
Apr 24 20:03:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb48eb51-b3c0-4962-ac66-44ff49456e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Flow 'volume_create_manager' (18d592de-c80e-48ff-b940-2fe89cb10332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:02 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-7b7ed9d6-557c-4136-a168-964d780027fd tempest-VolumesDeleteCascade-1241881483 None] Created volume successfully.
Apr 24 20:03:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] Creating offline snapshot 3eed0f64-63c4-4411-948c-06cc28cb8584 of volume 4c479e28-7c81-49b7-b259-78e984f49d02 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:03:03 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a61910-ee10-4aea-b5df-d64ff1ff12e2]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:03:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:03 devstack sudo[89225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02
Apr 24 20:03:03 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:04 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02" returned: 0 in 0.537s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:04 devstack sudo[89230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584 1G
Apr 24 20:03:04 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:04 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584 1G" returned: 0 in 0.580s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c479e28-7c81-49b7-b259-78e984f49d02 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:04 devstack sudo[89235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c479e28-7c81-49b7-b259-78e984f49d02 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584
Apr 24 20:03:04 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:05 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c479e28-7c81-49b7-b259-78e984f49d02 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584" returned: 0 in 0.492s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:05 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584 is being set with open permissions: ugo+rw
Apr 24 20:03:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:05 devstack sudo[89240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584
Apr 24 20:03:05 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:05 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584" returned: 0 in 0.436s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:05 devstack sudo[89243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.info
Apr 24 20:03:05 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:06 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.info" returned: 0 in 0.451s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:06 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.info is being set with open permissions: ugo+rw
Apr 24 20:03:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:06 devstack sudo[89246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.info
Apr 24 20:03:06 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:06 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.info" returned: 0 in 0.440s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.021s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:06 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-ed25a1a7-9d4d-4593-b251-3a6d8452fe23 tempest-VolumesDeleteCascade-1241881483 None] Create snapshot completed successfully
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Flow 'volume_create_manager' (0ad4482a-aa9a-42ab-a2bb-5fddbef8593f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc28d03-0300-4f7b-aae8-b0bc07c8004c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc28d03-0300-4f7b-aae8-b0bc07c8004c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-591580080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be91e92-b259-44b4-9bdd-8924d9a4dda8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6d8cb4f4a36498494729014585023fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3eed0f64-63c4-4411-948c-06cc28cb8584,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:07Z,use_quota=True,user_id='db2d0fa23cce46aabaa465790be17d7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c77d0e-5d53-488f-864b-f0ea05f61dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c77d0e-5d53-488f-864b-f0ea05f61dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6edb8092-6a38-4565-bcd1-912365404aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6edb8092-6a38-4565-bcd1-912365404aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0be91e92-b259-44b4-9bdd-8924d9a4dda8', 'volume_name': 'volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8', 'volume_size': 1, 'snapshot_id': '3eed0f64-63c4-4411-948c-06cc28cb8584'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d519c195-32be-44ba-a2c0-72d75c521707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d519c195-32be-44ba-a2c0-72d75c521707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d6de9e-f0f8-4466-851b-b798224fe08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:07 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Volume 0be91e92-b259-44b4-9bdd-8924d9a4dda8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8', 'volume_size': 1, 'snapshot_id': '3eed0f64-63c4-4411-948c-06cc28cb8584'}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-quobyte-3eed0f64-63c4-4411-948c-06cc28cb8584-0be91e92-b259-44b4-9bdd-8924d9a4dda8" by "_create_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-3eed0f64-63c4-4411-948c-06cc28cb8584-0be91e92-b259-44b4-9bdd-8924d9a4dda8" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Creating volume 0be91e92-b259-44b4-9bdd-8924d9a4dda8 from snapshot 3eed0f64-63c4-4411-948c-06cc28cb8584 {{(pid=81241) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-quobyte-0be91e92-b259-44b4-9bdd-8924d9a4dda8" by "_copy_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-0be91e92-b259-44b4-9bdd-8924d9a4dda8" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] snapshot: 3eed0f64-63c4-4411-948c-06cc28cb8584, volume: 0be91e92-b259-44b4-9bdd-8924d9a4dda8,  {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[20421363-9d09-46a1-a7b8-ce50bb642f18]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:07 devstack sudo[89249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584
Apr 24 20:03:07 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:07 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584" returned: 0 in 0.496s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c479e28-7c81-49b7-b259-78e984f49d02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02 {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Creating direct copy from snapshot {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba63600-f124-4092-b7ef-b2ae91711481]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:03:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:07 devstack sudo[89254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02
Apr 24 20:03:07 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:08 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02" returned: 0 in 0.505s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:08 devstack cinder-volume[81241]: DEBUG cinder.utils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Path /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8 not found in is_blk_device check {{(pid=81241) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 20:03:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:08 devstack sudo[89259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8
Apr 24 20:03:08 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:12 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8" returned: 0 in 4.225s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:12 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4905464-b783-4984-9fbc-e7bf466cad24]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:03:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:12 devstack sudo[89272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02
Apr 24 20:03:12 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:13 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02" returned: 0 in 0.628s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:13 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02, size 1024.00 MB, duration 4.23 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8 {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 20:03:13 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Converted 1024.00 MB image at 242.29 MB/s
Apr 24 20:03:13 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8 is being set with open permissions: ugo+rw
Apr 24 20:03:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:13 devstack sudo[89277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8
Apr 24 20:03:13 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:13 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8" returned: 0 in 0.473s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:13 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-0be91e92-b259-44b4-9bdd-8924d9a4dda8" released by "_copy_volume_from_snapshot" :: held 6.416s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:13 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-3eed0f64-63c4-4411-948c-06cc28cb8584-0be91e92-b259-44b4-9bdd-8924d9a4dda8" released by "_create_volume_from_snapshot" :: held 6.447s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.463s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d6de9e-f0f8-4466-851b-b798224fe08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8', 'volume_size': 1, 'snapshot_id': '3eed0f64-63c4-4411-948c-06cc28cb8584'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95719c14-4ecf-4c3f-8176-965be9eb54d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:13 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Volume volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8 (0be91e92-b259-44b4-9bdd-8924d9a4dda8): created successfully
Apr 24 20:03:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95719c14-4ecf-4c3f-8176-965be9eb54d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Flow 'volume_create_manager' (0ad4482a-aa9a-42ab-a2bb-5fddbef8593f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:13 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a952e4b8-0312-4d6e-8a5f-0127d052d65f tempest-VolumesDeleteCascade-1241881483 None] Created volume successfully.
Apr 24 20:03:14 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-4c479e28-7c81-49b7-b259-78e984f49d02-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:14 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-4c479e28-7c81-49b7-b259-78e984f49d02-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:14 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Performing cascade delete. {{(pid=81241) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 24 20:03:14 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-3eed0f64-63c4-4411-948c-06cc28cb8584-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:14 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-3eed0f64-63c4-4411-948c-06cc28cb8584-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:14 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-quobyte-4c479e28-7c81-49b7-b259-78e984f49d02" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:14 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-4c479e28-7c81-49b7-b259-78e984f49d02" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:14 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-quobyte-3eed0f64-63c4-4411-948c-06cc28cb8584" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:14 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-3eed0f64-63c4-4411-948c-06cc28cb8584" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:14 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Deleting offline snapshot 3eed0f64-63c4-4411-948c-06cc28cb8584 of volume 4c479e28-7c81-49b7-b259-78e984f49d02 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:03:14 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] snapshot_file for this snap is: volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:03:14 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53ea1aa-5b17-4880-bc60-12612f6bded0]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:03:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:15 devstack sudo[89280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584
Apr 24 20:03:15 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:15 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584" returned: 0 in 0.502s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c479e28-7c81-49b7-b259-78e984f49d02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:03:15 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[276d7bec-ac34-4078-b25d-4fb6b3db5380]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:03:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:15 devstack sudo[89285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02
Apr 24 20:03:15 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:16 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02" returned: 0 in 0.526s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:16 devstack sudo[89291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584
Apr 24 20:03:16 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:16 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584" returned: 0 in 0.533s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:16 devstack sudo[89296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584
Apr 24 20:03:16 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:17 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02.3eed0f64-63c4-4411-948c-06cc28cb8584" returned: 0 in 0.499s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:17 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-3eed0f64-63c4-4411-948c-06cc28cb8584" released by "_delete_snapshot" :: held 2.153s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:17 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-4c479e28-7c81-49b7-b259-78e984f49d02" released by "delete_snapshot" :: held 2.175s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:17 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Created reservations ['45d732a2-cac5-4cf9-84dd-010416964e04', '6de14bff-696d-411e-acaf-2d9dac205a49', 'a823d602-ff37-458d-ac36-08dd4946822f', '7fca6b3d-9fe1-4e6b-a926-9cc566d36488'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:03:17 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Delete snapshot completed successfully.
Apr 24 20:03:17 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-3eed0f64-63c4-4411-948c-06cc28cb8584-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Snapshots deleted, issuing volume delete {{(pid=81241) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 24 20:03:17 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-quobyte-4c479e28-7c81-49b7-b259-78e984f49d02" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:17 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-4c479e28-7c81-49b7-b259-78e984f49d02" acquired by "delete_volume" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:17 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[25017d9a-bb81-4687-9d84-f52cbe7c07ea]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:03:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:17 devstack sudo[89299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02
Apr 24 20:03:17 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:17 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02" returned: 0 in 0.508s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:17 devstack sudo[89304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02
Apr 24 20:03:17 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:18 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4c479e28-7c81-49b7-b259-78e984f49d02" returned: 0 in 0.427s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-4c479e28-7c81-49b7-b259-78e984f49d02" released by "delete_volume" :: held 0.990s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:18 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Created reservations ['3a3bca6b-c389-4f69-abf3-07705c66557c', '5a4e4819-53bd-4e20-9afa-e98ec74b8772', 'bcd8c10e-1e50-4355-8d0f-653a8969696f', 'e4256c86-a179-49c3-8c96-443bbe2749ed'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:03:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:18 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:18 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:18 devstack sudo[89307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:03:18 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:18 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.439s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:18 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:03:18 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Deleted volume successfully.
Apr 24 20:03:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-68ba0a4d-9e96-4ab7-a242-6864b45c0c8e tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-4c479e28-7c81-49b7-b259-78e984f49d02-delete_volume" released by "delete_volume" :: held 3.976s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-0be91e92-b259-44b4-9bdd-8924d9a4dda8-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-0be91e92-b259-44b4-9bdd-8924d9a4dda8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "cinder-quobyte-0be91e92-b259-44b4-9bdd-8924d9a4dda8" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-0be91e92-b259-44b4-9bdd-8924d9a4dda8" acquired by "delete_volume" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:19 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df9a755-1185-451f-919a-b1dce74f6d4d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:03:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:19 devstack sudo[89317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8
Apr 24 20:03:19 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:19 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8" returned: 0 in 0.562s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:19 devstack sudo[89322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8
Apr 24 20:03:19 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:20 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0be91e92-b259-44b4-9bdd-8924d9a4dda8" returned: 0 in 0.439s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-quobyte-0be91e92-b259-44b4-9bdd-8924d9a4dda8" released by "delete_volume" :: held 1.041s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:20 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Created reservations ['f99ed756-0bb9-4402-a8b9-f763e643cee4', 'a4ad82fc-bbeb-4fb8-8e03-ec295f650ebb', '0b5e904a-c9e3-494c-95c2-7de7be4c80f9', 'e8306d8b-bed7-4375-a597-b373a522dd9a'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:03:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:20 devstack sudo[89325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:03:20 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:20 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.427s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:20 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:03:20 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Deleted volume successfully.
Apr 24 20:03:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-064b91db-dd52-4bda-890b-4a863d52038b tempest-VolumesDeleteCascade-1241881483 None] Lock "cinder-0be91e92-b259-44b4-9bdd-8924d9a4dda8-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 20:03:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:24 devstack sudo[89331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:03:24 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:24 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.471s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:24 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Flow 'volume_create_manager' (137df4fa-76c6-4b3a-ab25-64d016234a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3354577-1b43-44d7-a82b-ab5c0d76fad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3354577-1b43-44d7-a82b-ab5c0d76fad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1852556515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7050bba-be23-439c-b5e3-52857f4c3d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0fbb8e4fe84e74b793809018934c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:25Z,use_quota=True,user_id='a760560ac8a049a9b8f6efb790898d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86459766-d15e-402a-b37a-19662ac9d501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86459766-d15e-402a-b37a-19662ac9d501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb01cbda-7d7d-411e-8abb-f91b12bf29ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb01cbda-7d7d-411e-8abb-f91b12bf29ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7050bba-be23-439c-b5e3-52857f4c3d78', 'volume_name': 'volume-d7050bba-be23-439c-b5e3-52857f4c3d78', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f482725d-dd4d-464c-af39-ebf11576d4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f482725d-dd4d-464c-af39-ebf11576d4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615f0221-96c0-4281-a721-275799304f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:25 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Volume d7050bba-be23-439c-b5e3-52857f4c3d78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7050bba-be23-439c-b5e3-52857f4c3d78', 'volume_size': 1}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1852556515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7050bba-be23-439c-b5e3-52857f4c3d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0fbb8e4fe84e74b793809018934c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:25Z,use_quota=True,user_id='a760560ac8a049a9b8f6efb790898d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Creating volume d7050bba-be23-439c-b5e3-52857f4c3d78 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:03:25 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d7050bba-be23-439c-b5e3-52857f4c3d78 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:25 devstack sudo[89334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d7050bba-be23-439c-b5e3-52857f4c3d78 1073741824
Apr 24 20:03:25 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:25 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d7050bba-be23-439c-b5e3-52857f4c3d78 1073741824" returned: 0 in 0.568s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d7050bba-be23-439c-b5e3-52857f4c3d78 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:25 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d7050bba-be23-439c-b5e3-52857f4c3d78
Apr 24 20:03:25 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:26 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d7050bba-be23-439c-b5e3-52857f4c3d78" returned: 0 in 0.458s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:03:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615f0221-96c0-4281-a721-275799304f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7050bba-be23-439c-b5e3-52857f4c3d78', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be557aad-7029-4c9c-a4c6-5f24c5265d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:26 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Volume volume-d7050bba-be23-439c-b5e3-52857f4c3d78 (d7050bba-be23-439c-b5e3-52857f4c3d78): created successfully
Apr 24 20:03:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be557aad-7029-4c9c-a4c6-5f24c5265d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Flow 'volume_create_manager' (137df4fa-76c6-4b3a-ab25-64d016234a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:26 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-73837344-ee35-429f-b35b-77d8e8447b55 tempest-VolumesTransfersTest-1541388096 None] Created volume successfully.
Apr 24 20:03:27 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f023f27e-4e2f-4b2d-9c43-b7b938c5d75f tempest-VolumesTransfersTest-1819274205 None] Transfer volume completed successfully.
Apr 24 20:03:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Acquiring lock "cinder-d7050bba-be23-439c-b5e3-52857f4c3d78-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Lock "cinder-d7050bba-be23-439c-b5e3-52857f4c3d78-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Acquiring lock "cinder-quobyte-d7050bba-be23-439c-b5e3-52857f4c3d78" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Lock "cinder-quobyte-d7050bba-be23-439c-b5e3-52857f4c3d78" acquired by "delete_volume" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:28 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebf374e-2bb2-4f0b-b47f-479c7bdbf71c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:03:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d7050bba-be23-439c-b5e3-52857f4c3d78 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:28 devstack sudo[89343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d7050bba-be23-439c-b5e3-52857f4c3d78
Apr 24 20:03:28 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:29 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d7050bba-be23-439c-b5e3-52857f4c3d78" returned: 0 in 0.509s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d7050bba-be23-439c-b5e3-52857f4c3d78 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:29 devstack sudo[89348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d7050bba-be23-439c-b5e3-52857f4c3d78
Apr 24 20:03:29 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:29 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d7050bba-be23-439c-b5e3-52857f4c3d78" returned: 0 in 0.411s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Lock "cinder-quobyte-d7050bba-be23-439c-b5e3-52857f4c3d78" released by "delete_volume" :: held 0.960s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:29 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Created reservations ['148473a9-1b4e-4890-9012-c9cf431c85c3', '87f8ecfc-1de9-48e6-97e4-2094d5e05aef', '3cc075ac-ba6d-4d0e-bf4f-70a480026336', '1e0b41d6-84c4-4215-b343-2805f5ea4834'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:03:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:29 devstack sudo[89352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:03:29 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Flow 'volume_create_manager' (d54b8a0e-cac2-4099-b9f8-58b7768ccb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c1fe67-c81d-410c-8411-13ca0ab3ec8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c1fe67-c81d-410c-8411-13ca0ab3ec8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-904952442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e01b37b-dbba-4c76-8c87-a21180ee31d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0fbb8e4fe84e74b793809018934c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:30Z,use_quota=True,user_id='a760560ac8a049a9b8f6efb790898d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6495f394-9190-480b-ba6b-21b19e732bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6495f394-9190-480b-ba6b-21b19e732bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7df2a6-d311-4825-82e6-7c11a9000f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7df2a6-d311-4825-82e6-7c11a9000f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e01b37b-dbba-4c76-8c87-a21180ee31d6', 'volume_name': 'volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b81869-bcff-4ac4-bad5-35da61a7c27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b81869-bcff-4ac4-bad5-35da61a7c27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a91225-d87f-4bbe-8575-32fcb7d90eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:30 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Volume 4e01b37b-dbba-4c76-8c87-a21180ee31d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6', 'volume_size': 1}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-904952442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e01b37b-dbba-4c76-8c87-a21180ee31d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0fbb8e4fe84e74b793809018934c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:30Z,use_quota=True,user_id='a760560ac8a049a9b8f6efb790898d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Creating volume 4e01b37b-dbba-4c76-8c87-a21180ee31d6 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:03:30 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:30 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.516s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:03:30 devstack sudo[89355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6 1073741824
Apr 24 20:03:30 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Deleted volume successfully.
Apr 24 20:03:30 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-14199e82-a63e-4baa-b968-fc12d8808f3b tempest-VolumesTransfersTest-983720764 None] Lock "cinder-d7050bba-be23-439c-b5e3-52857f4c3d78-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:30 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6 1073741824" returned: 0 in 0.579s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:30 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6
Apr 24 20:03:30 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:31 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6" returned: 0 in 0.447s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:03:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a91225-d87f-4bbe-8575-32fcb7d90eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca27578-df50-40cf-ad9f-f7d948ed9318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:31 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Volume volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6 (4e01b37b-dbba-4c76-8c87-a21180ee31d6): created successfully
Apr 24 20:03:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca27578-df50-40cf-ad9f-f7d948ed9318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Flow 'volume_create_manager' (d54b8a0e-cac2-4099-b9f8-58b7768ccb3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:31 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-3db3c5e3-62eb-49d3-8e9f-5d0f9079df56 tempest-VolumesTransfersTest-1541388096 None] Created volume successfully.
Apr 24 20:03:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Acquiring lock "cinder-4e01b37b-dbba-4c76-8c87-a21180ee31d6-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Lock "cinder-4e01b37b-dbba-4c76-8c87-a21180ee31d6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Acquiring lock "cinder-quobyte-4e01b37b-dbba-4c76-8c87-a21180ee31d6" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Lock "cinder-quobyte-4e01b37b-dbba-4c76-8c87-a21180ee31d6" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:32 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeca02a-4c97-465d-9d9d-fa3024ee30a4]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:03:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:32 devstack sudo[89363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6
Apr 24 20:03:32 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:33 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6" returned: 0 in 0.509s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:33 devstack sudo[89368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6
Apr 24 20:03:33 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:33 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4e01b37b-dbba-4c76-8c87-a21180ee31d6" returned: 0 in 0.409s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:33 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Lock "cinder-quobyte-4e01b37b-dbba-4c76-8c87-a21180ee31d6" released by "delete_volume" :: held 0.958s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:33 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Created reservations ['7e212794-3f3e-43ad-9138-47a3d87fec05', 'c4479826-1394-4fd7-aaa4-868479bbe298', 'd245a1a1-f825-4adc-8514-fba9d397f341', 'ec75dded-efe0-4d9a-abee-a1b8fc0f834d'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:03:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:33 devstack sudo[89371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:03:33 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:34 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.419s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:34 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:03:34 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Deleted volume successfully.
Apr 24 20:03:34 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d32ca22a-0aff-4210-ab7f-4bfbf1efa13e tempest-VolumesTransfersTest-983720764 None] Lock "cinder-4e01b37b-dbba-4c76-8c87-a21180ee31d6-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Flow 'volume_create_manager' (77a312d6-1f1f-404d-acd8-1b225b302e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6e7ae6-a9f2-49e3-95f3-bb4f538eea24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6e7ae6-a9f2-49e3-95f3-bb4f538eea24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-270064195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c974d79-e2ad-4aaa-a79f-d9ba3e247e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cacbfb173fa4bd6b20ced527b9de043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:39Z,use_quota=True,user_id='a66e411c3b104c1192fc41e8013e191e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9c0a0e-b9cb-406c-add0-4cc2420e5a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9c0a0e-b9cb-406c-add0-4cc2420e5a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbb927e-aca1-421d-ab97-610f60651abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbb927e-aca1-421d-ab97-610f60651abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c974d79-e2ad-4aaa-a79f-d9ba3e247e53', 'volume_name': 'volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53', 'volume_size': 2}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9659f787-142d-48e4-a090-537f8d66e6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9659f787-142d-48e4-a090-537f8d66e6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0e34ae-5b08-49dc-80cc-57a765da6582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:39 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Volume 7c974d79-e2ad-4aaa-a79f-d9ba3e247e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53', 'volume_size': 2}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-270064195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c974d79-e2ad-4aaa-a79f-d9ba3e247e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cacbfb173fa4bd6b20ced527b9de043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:39Z,use_quota=True,user_id='a66e411c3b104c1192fc41e8013e191e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Creating volume 7c974d79-e2ad-4aaa-a79f-d9ba3e247e53 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:03:39 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53 2147483648 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:39 devstack sudo[89374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53 2147483648
Apr 24 20:03:39 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:39 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53 2147483648" returned: 0 in 0.626s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:39 devstack sudo[89380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53
Apr 24 20:03:39 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:40 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53" returned: 0 in 0.455s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:40 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:03:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0e34ae-5b08-49dc-80cc-57a765da6582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53', 'volume_size': 2}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4764b082-5baa-4b24-b9f5-d1e05cb26cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:40 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Volume volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53 (7c974d79-e2ad-4aaa-a79f-d9ba3e247e53): created successfully
Apr 24 20:03:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4764b082-5baa-4b24-b9f5-d1e05cb26cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Flow 'volume_create_manager' (77a312d6-1f1f-404d-acd8-1b225b302e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:40 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0e3d66be-bf8b-4480-820f-d7bad554e9a4 tempest-VolumesCloneNegativeTest-1376737817 None] Created volume successfully.
Apr 24 20:03:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Acquiring lock "cinder-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Lock "cinder-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Acquiring lock "cinder-quobyte-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Lock "cinder-quobyte-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53" acquired by "delete_volume" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:41 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d608843-3a73-4b2f-b6a5-0dabb2d51210]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:03:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:41 devstack sudo[89417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53
Apr 24 20:03:41 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:41 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53" returned: 0 in 0.493s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:41 devstack sudo[89422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53
Apr 24 20:03:41 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:42 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53" returned: 0 in 0.429s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Lock "cinder-quobyte-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53" released by "delete_volume" :: held 0.962s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:42 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Created reservations ['f9b13a5f-979c-4062-824d-55f3370ba186', 'b83b5edd-01e0-453e-93f7-a089e30e81eb', '6d2c23d2-a575-40a6-af16-9cf4d893a6d6', '1a6d9e57-bdc0-4c7c-9931-2d362127434b'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:03:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:42 devstack sudo[89425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:03:42 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:42 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.423s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:42 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:03:42 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Deleted volume successfully.
Apr 24 20:03:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-fa06b0d4-fd23-4111-a826-7ea628233597 tempest-VolumesCloneNegativeTest-1376737817 None] Lock "cinder-7c974d79-e2ad-4aaa-a79f-d9ba3e247e53-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Flow 'volume_create_manager' (24d3d105-7c69-4fe6-bc41-f92224c6a61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d031ea-f663-4f3a-861b-cf5a3af168e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d031ea-f663-4f3a-861b-cf5a3af168e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1365795829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5dda5d4-bcfe-4115-aac5-c8280a8def45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='15e02e29ef63414f976a01f0b6f588c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:46Z,use_quota=True,user_id='6b9d80ed2e694b9e9ffc758f3d52abd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c666197-f163-4000-8ad8-e5919a7afc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c666197-f163-4000-8ad8-e5919a7afc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13dfe785-61f1-48db-a81d-3d3a5680fe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13dfe785-61f1-48db-a81d-3d3a5680fe8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5dda5d4-bcfe-4115-aac5-c8280a8def45', 'volume_name': 'volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a3310c-d2b3-46fe-a20f-466d61514684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a3310c-d2b3-46fe-a20f-466d61514684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f792a22e-a09f-48e4-8119-4b9752db1274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:45 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Volume c5dda5d4-bcfe-4115-aac5-c8280a8def45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45', 'volume_size': 1}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1365795829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5dda5d4-bcfe-4115-aac5-c8280a8def45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='15e02e29ef63414f976a01f0b6f588c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:46Z,use_quota=True,user_id='6b9d80ed2e694b9e9ffc758f3d52abd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Creating volume c5dda5d4-bcfe-4115-aac5-c8280a8def45 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:03:45 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:03:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:45 devstack sudo[89428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45 1073741824
Apr 24 20:03:45 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:46 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45 1073741824" returned: 0 in 0.605s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:46 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:DELETE=12,cinder:SELECT=81,cinder:UPDATE=109,cinder:INSERT=28 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:03:46 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:UPDATE=119,cinder:SELECT=94,cinder:INSERT=30,cinder:DELETE=6 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:03:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:46 devstack sudo[89433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45
Apr 24 20:03:46 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:46 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45" returned: 0 in 0.420s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:03:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f792a22e-a09f-48e4-8119-4b9752db1274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58f96c3-c186-4035-a57b-945f25121e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:46 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Volume volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45 (c5dda5d4-bcfe-4115-aac5-c8280a8def45): created successfully
Apr 24 20:03:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58f96c3-c186-4035-a57b-945f25121e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Flow 'volume_create_manager' (24d3d105-7c69-4fe6-bc41-f92224c6a61a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:46 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-1dda071e-ed3a-46b0-937c-1972a799dadf tempest-VolumesListTestJSON-397663626 None] Created volume successfully.
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Flow 'volume_create_manager' (8fd350a4-412a-4494-bf57-48d198057c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b08003-bc80-4d90-9704-128186c992ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b08003-bc80-4d90-9704-128186c992ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-177935343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='15e02e29ef63414f976a01f0b6f588c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:48Z,use_quota=True,user_id='6b9d80ed2e694b9e9ffc758f3d52abd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bca18b-c5d1-4127-99f0-47cf344f54eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bca18b-c5d1-4127-99f0-47cf344f54eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8772ab-a7ad-4d3c-9fa3-01f0454e1dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8772ab-a7ad-4d3c-9fa3-01f0454e1dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9', 'volume_name': 'volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d11a4637-f041-4757-8b4a-5f7560af83f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d11a4637-f041-4757-8b4a-5f7560af83f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3843bf-5304-48a8-8919-35ba2a79f343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:48 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Volume 12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9', 'volume_size': 1}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-177935343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='15e02e29ef63414f976a01f0b6f588c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:48Z,use_quota=True,user_id='6b9d80ed2e694b9e9ffc758f3d52abd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Creating volume 12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:03:48 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:48 devstack sudo[89436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9 1073741824
Apr 24 20:03:48 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:48 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9 1073741824" returned: 0 in 0.577s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:48 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9
Apr 24 20:03:48 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:49 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9" returned: 0 in 0.451s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:03:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3843bf-5304-48a8-8919-35ba2a79f343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad205a1b-626e-4fa0-a1a9-9fd33e84901c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:49 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Volume volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9 (12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9): created successfully
Apr 24 20:03:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad205a1b-626e-4fa0-a1a9-9fd33e84901c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Flow 'volume_create_manager' (8fd350a4-412a-4494-bf57-48d198057c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:49 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d783f796-98ed-4515-845e-121e17165a56 tempest-VolumesListTestJSON-397663626 None] Created volume successfully.
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Flow 'volume_create_manager' (a908edb3-310e-438b-8685-aa82b57e2f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c344e28-2f30-4d72-9370-20a6bad7f5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c344e28-2f30-4d72-9370-20a6bad7f5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-954924903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604076f9-01c8-49a7-87c0-62c10369b909,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='15e02e29ef63414f976a01f0b6f588c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:51Z,use_quota=True,user_id='6b9d80ed2e694b9e9ffc758f3d52abd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da21f85-3716-4a8b-a013-c4be882d9c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da21f85-3716-4a8b-a013-c4be882d9c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc66277-0d8f-4e10-a3ca-5236dd8cb75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc66277-0d8f-4e10-a3ca-5236dd8cb75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '604076f9-01c8-49a7-87c0-62c10369b909', 'volume_name': 'volume-604076f9-01c8-49a7-87c0-62c10369b909', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e22043-03aa-4d28-8b4b-afea5215add8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e22043-03aa-4d28-8b4b-afea5215add8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec7c2d9-7b55-45ba-be0c-789760a1d2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:50 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Volume 604076f9-01c8-49a7-87c0-62c10369b909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-604076f9-01c8-49a7-87c0-62c10369b909', 'volume_size': 1}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-954924903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604076f9-01c8-49a7-87c0-62c10369b909,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='15e02e29ef63414f976a01f0b6f588c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:51Z,use_quota=True,user_id='6b9d80ed2e694b9e9ffc758f3d52abd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Creating volume 604076f9-01c8-49a7-87c0-62c10369b909 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:03:50 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:03:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-604076f9-01c8-49a7-87c0-62c10369b909 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:50 devstack sudo[89445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-604076f9-01c8-49a7-87c0-62c10369b909 1073741824
Apr 24 20:03:50 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:51 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-604076f9-01c8-49a7-87c0-62c10369b909 1073741824" returned: 0 in 0.618s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-604076f9-01c8-49a7-87c0-62c10369b909 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:51 devstack sudo[89450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-604076f9-01c8-49a7-87c0-62c10369b909
Apr 24 20:03:51 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:51 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-604076f9-01c8-49a7-87c0-62c10369b909" returned: 0 in 0.425s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:03:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec7c2d9-7b55-45ba-be0c-789760a1d2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-604076f9-01c8-49a7-87c0-62c10369b909', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb761e3-5ead-486e-b1bb-5e857a617988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:03:51 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Volume volume-604076f9-01c8-49a7-87c0-62c10369b909 (604076f9-01c8-49a7-87c0-62c10369b909): created successfully
Apr 24 20:03:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb761e3-5ead-486e-b1bb-5e857a617988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:03:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Flow 'volume_create_manager' (a908edb3-310e-438b-8685-aa82b57e2f1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:03:51 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-092bddf6-0a3d-42a6-bf0d-fd5fc1f352ca tempest-VolumesListTestJSON-397663626 None] Created volume successfully.
Apr 24 20:03:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Acquiring lock "cinder-604076f9-01c8-49a7-87c0-62c10369b909-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Lock "cinder-604076f9-01c8-49a7-87c0-62c10369b909-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Acquiring lock "cinder-quobyte-604076f9-01c8-49a7-87c0-62c10369b909" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Lock "cinder-quobyte-604076f9-01c8-49a7-87c0-62c10369b909" acquired by "delete_volume" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:55 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[34adb032-da44-40a1-96fe-ade5a5d2e4f0]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:03:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-604076f9-01c8-49a7-87c0-62c10369b909 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:55 devstack sudo[89453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-604076f9-01c8-49a7-87c0-62c10369b909
Apr 24 20:03:55 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:55 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-604076f9-01c8-49a7-87c0-62c10369b909" returned: 0 in 0.512s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-604076f9-01c8-49a7-87c0-62c10369b909 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:55 devstack sudo[89458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-604076f9-01c8-49a7-87c0-62c10369b909
Apr 24 20:03:55 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:56 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-604076f9-01c8-49a7-87c0-62c10369b909" returned: 0 in 0.421s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Lock "cinder-quobyte-604076f9-01c8-49a7-87c0-62c10369b909" released by "delete_volume" :: held 0.969s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:56 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Created reservations ['34b1971d-3425-4212-b0a6-e1037caf2c66', 'fa72163c-a560-4b62-89d3-bb9cf953d407', 'ac235967-15c8-4b82-bf7f-1940bb6ab0b2', 'b2061488-aac8-4d38-a097-7ddc9c583b5a'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:03:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:56 devstack sudo[89461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:03:56 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:56 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.409s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:56 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:03:56 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Deleted volume successfully.
Apr 24 20:03:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5fb9cbcb-8f80-4cf2-979f-f618dbee854e tempest-VolumesListTestJSON-397663626 None] Lock "cinder-604076f9-01c8-49a7-87c0-62c10369b909-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Acquiring lock "cinder-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Lock "cinder-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Acquiring lock "cinder-quobyte-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:57 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Lock "cinder-quobyte-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9" acquired by "delete_volume" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:57 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5f7376-6944-47eb-9651-64ce53fba3ca]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:03:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:57 devstack sudo[89464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9
Apr 24 20:03:57 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:57 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9" returned: 0 in 0.496s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:57 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9
Apr 24 20:03:57 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:58 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9" returned: 0 in 0.425s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Lock "cinder-quobyte-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9" released by "delete_volume" :: held 0.958s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Created reservations ['42b52157-5923-405f-b7b9-79b03fbac58c', '488a8b87-b0ef-4688-a6d8-c43f55ef1a07', '144ded95-a178-4987-a801-82a66c2eddb7', '37a8d160-1cb5-4014-bba3-4713a42bcb38'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:58 devstack sudo[89472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:03:58 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Acquiring lock "cinder-c5dda5d4-bcfe-4115-aac5-c8280a8def45-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Lock "cinder-c5dda5d4-bcfe-4115-aac5-c8280a8def45-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Acquiring lock "cinder-quobyte-c5dda5d4-bcfe-4115-aac5-c8280a8def45" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Lock "cinder-quobyte-c5dda5d4-bcfe-4115-aac5-c8280a8def45" acquired by "delete_volume" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a5496e-8af2-4117-b312-11343581a92c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:58 devstack sudo[89474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45
Apr 24 20:03:58 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:58 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.446s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:03:58 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Deleted volume successfully.
Apr 24 20:03:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-23397684-2000-4b31-ae5a-be968b926dcc tempest-VolumesListTestJSON-397663626 None] Lock "cinder-12f1ff10-cb5b-4b2f-b49b-b75cce3a62d9-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:59 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45" returned: 0 in 0.521s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:59 devstack sudo[89480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45
Apr 24 20:03:59 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:03:59 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root
Apr 24 20:03:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c5dda5d4-bcfe-4115-aac5-c8280a8def45" returned: 0 in 0.425s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:03:59 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Lock "cinder-quobyte-c5dda5d4-bcfe-4115-aac5-c8280a8def45" released by "delete_volume" :: held 0.984s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:03:59 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Created reservations ['5dcaa1ed-c44d-4050-8b9c-35df9ea5e427', '8f40af25-9263-43b1-8b0c-00f4b47f57d5', '9f13ebdd-f3a1-4206-bb71-e24436cd3536', '9c94f41e-d38c-4c2e-aa96-c24ebd370f52'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:03:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:03:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:03:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:03:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:03:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:03:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:03:59 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:03:59 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:00 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.416s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:00 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:04:00 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Deleted volume successfully.
Apr 24 20:04:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-686659e8-b453-411a-baa9-b85dacdd5142 tempest-VolumesListTestJSON-397663626 None] Lock "cinder-c5dda5d4-bcfe-4115-aac5-c8280a8def45-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Flow 'volume_create_manager' (04793f6a-b370-463a-9524-af902fcda148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1864ff42-90f7-4796-8c46-ef584f895736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1864ff42-90f7-4796-8c46-ef584f895736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-249782221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c62d5c-c0b0-4e1c-8c3f-dd4431834127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e520fc3c8d4e64b0857c1d30c07375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:03Z,use_quota=True,user_id='891c82ae07704238a0ad872fca553d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158644ed-0540-47fc-a514-65b763657a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158644ed-0540-47fc-a514-65b763657a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd677ab-cd80-497b-ae0d-18f3b6623101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd677ab-cd80-497b-ae0d-18f3b6623101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c62d5c-c0b0-4e1c-8c3f-dd4431834127', 'volume_name': 'volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9fbc35-820f-47ee-bd8f-e06ccd2c4605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9fbc35-820f-47ee-bd8f-e06ccd2c4605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d457f111-ea06-46d7-9271-36ff27b8337a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:03 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Volume e4c62d5c-c0b0-4e1c-8c3f-dd4431834127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127', 'volume_size': 1}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-249782221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c62d5c-c0b0-4e1c-8c3f-dd4431834127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e520fc3c8d4e64b0857c1d30c07375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:03Z,use_quota=True,user_id='891c82ae07704238a0ad872fca553d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Creating volume e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:04:03 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:03 devstack sudo[89487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 1073741824
Apr 24 20:04:03 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:03 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 1073741824" returned: 0 in 0.592s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:03 devstack sudo[89492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127
Apr 24 20:04:03 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:04 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" returned: 0 in 0.448s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:04:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d457f111-ea06-46d7-9271-36ff27b8337a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95813100-5aa1-4bc6-9a55-d2b1e59ac395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:04 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Volume volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 (e4c62d5c-c0b0-4e1c-8c3f-dd4431834127): created successfully
Apr 24 20:04:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95813100-5aa1-4bc6-9a55-d2b1e59ac395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:04 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Flow 'volume_create_manager' (04793f6a-b370-463a-9524-af902fcda148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:04 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e8bd91dd-b809-42c0-94a4-5f1e75100e58 tempest-VolumesSnapshotListTestJSON-2015492692 None] Created volume successfully.
Apr 24 20:04:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] Creating offline snapshot de84b371-e61d-40b9-93c2-9ebb2e952214 of volume e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:04:05 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4ee613-6ce3-461f-8955-9335cc8842c4]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:05 devstack sudo[89495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127
Apr 24 20:04:05 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:05 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" returned: 0 in 0.512s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:05 devstack sudo[89500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 1G
Apr 24 20:04:05 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:06 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 1G" returned: 0 in 0.630s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:06 devstack sudo[89505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214
Apr 24 20:04:06 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:07 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214" returned: 0 in 0.461s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:07 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 is being set with open permissions: ugo+rw
Apr 24 20:04:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:07 devstack sudo[89510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214
Apr 24 20:04:07 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:07 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214" returned: 0 in 0.446s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:07 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.info
Apr 24 20:04:07 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:07 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.info" returned: 0 in 0.441s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:07 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.info is being set with open permissions: ugo+rw
Apr 24 20:04:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:07 devstack sudo[89516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.info
Apr 24 20:04:07 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:08 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.info" returned: 0 in 0.423s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.993s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:08 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d67e867b-5d53-4f1c-aa4e-724f9b078fa8 tempest-VolumesSnapshotListTestJSON-2015492692 None] Create snapshot completed successfully
Apr 24 20:04:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] Creating offline snapshot e513ed5c-840d-4bdd-8975-ce5339f7f574 of volume e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:04:08 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddeb591c-26f0-4541-b109-b719efe8ff8f]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:08 devstack sudo[89519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214
Apr 24 20:04:08 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:09 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214" returned: 0 in 0.508s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:04:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:09 devstack sudo[89524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 1G
Apr 24 20:04:09 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:09 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 1G" returned: 0 in 0.598s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:09 devstack sudo[89530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574
Apr 24 20:04:09 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:10 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574" returned: 0 in 0.454s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:10 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 is being set with open permissions: ugo+rw
Apr 24 20:04:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:10 devstack sudo[89535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574
Apr 24 20:04:10 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:10 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574" returned: 0 in 0.408s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:10 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-20502a0e-2c97-43dd-9f77-e7d003e3184d tempest-VolumesSnapshotListTestJSON-2015492692 None] Create snapshot completed successfully
Apr 24 20:04:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:11 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] Creating offline snapshot 87e3ca7c-bbfb-4364-840d-203412d140a9 of volume e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:04:12 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[26daf217-7458-4739-a810-31213f1e2759]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:12 devstack sudo[89538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574
Apr 24 20:04:12 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:12 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574" returned: 0 in 0.490s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:04:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:12 devstack sudo[89543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9 1G
Apr 24 20:04:12 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:13 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9 1G" returned: 0 in 0.633s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:13 devstack sudo[89548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9
Apr 24 20:04:13 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:13 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9" returned: 0 in 0.443s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:13 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9 is being set with open permissions: ugo+rw
Apr 24 20:04:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:13 devstack sudo[89553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9
Apr 24 20:04:13 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:13 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9" returned: 0 in 0.413s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.067s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:14 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8e62b197-e966-4897-8748-736719969add tempest-VolumesSnapshotListTestJSON-2015492692 None] Create snapshot completed successfully
Apr 24 20:04:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "cinder-87e3ca7c-bbfb-4364-840d-203412d140a9-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-87e3ca7c-bbfb-4364-840d-203412d140a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "cinder-quobyte-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-quobyte-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "cinder-quobyte-87e3ca7c-bbfb-4364-840d-203412d140a9" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-quobyte-87e3ca7c-bbfb-4364-840d-203412d140a9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Deleting offline snapshot 87e3ca7c-bbfb-4364-840d-203412d140a9 of volume e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:04:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] snapshot_file for this snap is: volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:04:15 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcfd5ec-12c7-4ac4-8a4b-dfe4c35b4298]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:15 devstack sudo[89556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9
Apr 24 20:04:15 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:16 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9" returned: 0 in 0.551s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:04:16 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c535ff6a-0ddb-4ecc-9018-69d3e28a5b9b]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:16 devstack sudo[89561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574
Apr 24 20:04:16 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:16 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574" returned: 0 in 0.553s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:04:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:16 devstack sudo[89567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9
Apr 24 20:04:16 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:17 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9" returned: 0 in 0.599s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:17 devstack sudo[89572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9
Apr 24 20:04:17 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:18 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.87e3ca7c-bbfb-4364-840d-203412d140a9" returned: 0 in 0.446s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-quobyte-87e3ca7c-bbfb-4364-840d-203412d140a9" released by "_delete_snapshot" :: held 2.237s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-quobyte-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" released by "delete_snapshot" :: held 2.263s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:18 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Created reservations ['f229f191-d390-4cad-933c-af960a6b6004', '9cc6783a-f7c9-449b-a97a-a5b343ff0619', '77e236de-70e3-4d45-a5ab-23d34f155163', '15df02d8-5189-42b0-85ef-115ceb83f04b'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:04:18 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Delete snapshot completed successfully.
Apr 24 20:04:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8d3095b7-735a-4a39-a835-7b3f39cb9769 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-87e3ca7c-bbfb-4364-840d-203412d140a9-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "cinder-e513ed5c-840d-4bdd-8975-ce5339f7f574-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-e513ed5c-840d-4bdd-8975-ce5339f7f574-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "cinder-quobyte-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-quobyte-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "cinder-quobyte-e513ed5c-840d-4bdd-8975-ce5339f7f574" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:19 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-quobyte-e513ed5c-840d-4bdd-8975-ce5339f7f574" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Deleting offline snapshot e513ed5c-840d-4bdd-8975-ce5339f7f574 of volume e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:04:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] snapshot_file for this snap is: volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:04:19 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f810f4-5b0b-42d3-ad23-c1389ef0f8eb]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:19 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574
Apr 24 20:04:19 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:19 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574" returned: 0 in 0.509s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:04:19 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f3eb7a-1afa-46ad-80f9-c82a82494a54]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:19 devstack sudo[89587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214
Apr 24 20:04:19 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:20 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214" returned: 0 in 0.502s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:04:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:20 devstack sudo[89592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574
Apr 24 20:04:20 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:20 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574" returned: 0 in 0.562s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:20 devstack sudo[89597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574
Apr 24 20:04:20 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:21 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.e513ed5c-840d-4bdd-8975-ce5339f7f574" returned: 0 in 0.418s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:21 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-quobyte-e513ed5c-840d-4bdd-8975-ce5339f7f574" released by "_delete_snapshot" :: held 2.093s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:21 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-quobyte-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" released by "delete_snapshot" :: held 2.154s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:21 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Created reservations ['1c1420e5-56a4-40fb-85e5-1e1d8af35624', 'a7177631-b961-4754-8c09-3871302c0a8f', '00e2cc11-5d03-4dc8-906b-f57510d0472d', '187ebbea-2a5d-4f45-b1b5-8d14b9daf265'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:04:21 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Delete snapshot completed successfully.
Apr 24 20:04:21 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-89158e88-7b04-489a-a924-d1448b72351f tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-e513ed5c-840d-4bdd-8975-ce5339f7f574-delete_snapshot" released by "delete_snapshot" :: held 2.285s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "cinder-de84b371-e61d-40b9-93c2-9ebb2e952214-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-de84b371-e61d-40b9-93c2-9ebb2e952214-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "cinder-quobyte-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-quobyte-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "cinder-quobyte-de84b371-e61d-40b9-93c2-9ebb2e952214" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-quobyte-de84b371-e61d-40b9-93c2-9ebb2e952214" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:22 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Deleting offline snapshot de84b371-e61d-40b9-93c2-9ebb2e952214 of volume e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:04:22 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] snapshot_file for this snap is: volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:04:22 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cdf573-531e-4ed7-b0c7-8d158c16db70]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:22 devstack sudo[89600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214
Apr 24 20:04:22 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:22 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214" returned: 0 in 0.490s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:22 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:04:22 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[094f7de8-9c77-4e9b-aa43-a0f92c777a9c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:22 devstack sudo[89607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127
Apr 24 20:04:22 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:23 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" returned: 0 in 0.522s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:23 devstack sudo[89612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214
Apr 24 20:04:23 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:23 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214" returned: 0 in 0.507s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:23 devstack sudo[89617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214
Apr 24 20:04:23 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 20:04:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:24 devstack sudo[89619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:04:24 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:24 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127.de84b371-e61d-40b9-93c2-9ebb2e952214" returned: 0 in 0.417s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-quobyte-de84b371-e61d-40b9-93c2-9ebb2e952214" released by "_delete_snapshot" :: held 2.050s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-quobyte-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" released by "delete_snapshot" :: held 2.077s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:24 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Created reservations ['5e1b303a-05f9-42e6-8254-2b59ddcf01a0', '87aa46d4-f9fe-45c0-b675-0d176c19d0ba', 'bffe02e6-dbb8-407b-87df-f2489a6ce403', '8118bae9-4d4f-4d35-9961-ceb74bbb2df8'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:04:24 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Delete snapshot completed successfully.
Apr 24 20:04:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3dfd17a0-1048-48de-bd24-077d9bf77af6 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-de84b371-e61d-40b9-93c2-9ebb2e952214-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:24 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.439s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:24 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:04:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "cinder-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "cinder-quobyte-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-quobyte-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" acquired by "delete_volume" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:25 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad6f444-c24c-48ca-bbc3-182267e221b7]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:25 devstack sudo[89623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127
Apr 24 20:04:25 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:25 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" returned: 0 in 0.488s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:25 devstack sudo[89628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127
Apr 24 20:04:25 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:26 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" returned: 0 in 0.444s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-quobyte-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127" released by "delete_volume" :: held 0.987s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:26 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Created reservations ['3a96651e-7dde-417f-ba0d-0cb7ad824028', '4c7d2669-0b75-4201-9c34-b68f73edb5a9', 'd28a21b3-5e11-4b78-8eea-335c0c85850c', 'bfaef331-ce2b-4947-b92c-8286b11f5996'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:04:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:26 devstack sudo[89631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:04:26 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:26 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.413s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:26 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:04:26 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Deleted volume successfully.
Apr 24 20:04:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e66bfb84-3ea1-4fa4-bc3c-395b45a05b77 tempest-VolumesSnapshotListTestJSON-2015492692 None] Lock "cinder-e4c62d5c-c0b0-4e1c-8c3f-dd4431834127-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:29 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:04:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Flow 'volume_create_manager' (09bcfb2f-6a32-4335-816e-219d59860447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c8198e-9276-412e-8fd6-5198a83c03b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c8198e-9276-412e-8fd6-5198a83c03b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-549550782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f6c9328bfd480fb41f6481ba90b6f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:30Z,use_quota=True,user_id='130aec3c2a3442fbb349e63d114fd693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d1825e-b22e-484d-8db4-dd18db3db0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d1825e-b22e-484d-8db4-dd18db3db0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b217b4-50f5-41a8-95cc-604e5c29d8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b217b4-50f5-41a8-95cc-604e5c29d8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14', 'volume_name': 'volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5faff492-4f3a-401f-8bc1-e59e06d1a343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5faff492-4f3a-401f-8bc1-e59e06d1a343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c926d90-75a0-4419-bf99-43d23958d8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Volume f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14', 'volume_size': 1}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-549550782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f6c9328bfd480fb41f6481ba90b6f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:30Z,use_quota=True,user_id='130aec3c2a3442fbb349e63d114fd693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Creating volume f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:04:30 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:30 devstack sudo[89636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14 1073741824
Apr 24 20:04:30 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Flow 'volume_create_manager' (678ba7ca-6c7f-4e5d-a1c8-c36cf7fae03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6d5612-e326-48b8-ab23-8ef68b0a2ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6d5612-e326-48b8-ab23-8ef68b0a2ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1847350255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376881df-3421-4526-b0e2-d26c44851390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f6c9328bfd480fb41f6481ba90b6f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:30Z,use_quota=True,user_id='130aec3c2a3442fbb349e63d114fd693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef190b9-5f4c-4793-a028-237c6f86388f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef190b9-5f4c-4793-a028-237c6f86388f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45ecedd-2de6-47ad-ac9f-4ab04663e1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45ecedd-2de6-47ad-ac9f-4ab04663e1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376881df-3421-4526-b0e2-d26c44851390', 'volume_name': 'volume-376881df-3421-4526-b0e2-d26c44851390', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a98befb-5af8-4c01-9496-28577524a759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a98befb-5af8-4c01-9496-28577524a759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fd25cc-0682-4103-8e2d-40d10b8b0789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Volume 376881df-3421-4526-b0e2-d26c44851390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376881df-3421-4526-b0e2-d26c44851390', 'volume_size': 1}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Flow 'volume_create_manager' (e1836aec-5429-42fc-9fb7-8ebc2af875d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04bb03f-e8f0-4278-8db6-1bed90c73fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04bb03f-e8f0-4278-8db6-1bed90c73fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-482409939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed6577f-c5e2-4435-9d2a-746902028626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f6c9328bfd480fb41f6481ba90b6f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:30Z,use_quota=True,user_id='130aec3c2a3442fbb349e63d114fd693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3489d9bc-cf7d-4e60-b32b-8c4125ab3494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3489d9bc-cf7d-4e60-b32b-8c4125ab3494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4f2a71-c4de-4869-b4d2-821412c79b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4f2a71-c4de-4869-b4d2-821412c79b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed6577f-c5e2-4435-9d2a-746902028626', 'volume_name': 'volume-0ed6577f-c5e2-4435-9d2a-746902028626', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e1dbce-e47d-49dd-acc8-e2cc769d2311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e1dbce-e47d-49dd-acc8-e2cc769d2311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a00e46-12b4-42e5-9593-7ddfe1dc2e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Volume 0ed6577f-c5e2-4435-9d2a-746902028626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed6577f-c5e2-4435-9d2a-746902028626', 'volume_size': 1}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:30 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14 1073741824" returned: 0 in 0.652s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Flow 'volume_create_manager' (06dbbd28-2eb3-4d70-a263-05f4f8214639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e0b0db-cb23-4221-8cd3-b7fa87f76225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e0b0db-cb23-4221-8cd3-b7fa87f76225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1159346245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f2546c-2694-4a3f-8795-6b9b96cc594d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f6c9328bfd480fb41f6481ba90b6f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:31Z,use_quota=True,user_id='130aec3c2a3442fbb349e63d114fd693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a978464-e15c-4cd6-aa6b-fa279a7eda46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a978464-e15c-4cd6-aa6b-fa279a7eda46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f05ea612-d0dd-4f2a-99e8-38028ee68509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f05ea612-d0dd-4f2a-99e8-38028ee68509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9f2546c-2694-4a3f-8795-6b9b96cc594d', 'volume_name': 'volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776eb337-d0b5-473e-a00f-98df18e9fbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776eb337-d0b5-473e-a00f-98df18e9fbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3469bd3a-788e-465b-b030-50663bc7056f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:30 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Volume f9f2546c-2694-4a3f-8795-6b9b96cc594d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d', 'volume_size': 1}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:30 devstack sudo[89641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14
Apr 24 20:04:30 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Flow 'volume_create_manager' (33837271-26be-45f9-8ea9-4ca2c11f324e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c271c4-2213-47b3-8e01-e71a2f2bf222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c271c4-2213-47b3-8e01-e71a2f2bf222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-798177717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc6758a-49aa-40aa-b337-2127b9deac3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f6c9328bfd480fb41f6481ba90b6f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:31Z,use_quota=True,user_id='130aec3c2a3442fbb349e63d114fd693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b535da-918f-44a0-8235-f6f38d9a7f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b535da-918f-44a0-8235-f6f38d9a7f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21529e06-bbe8-4751-8ff5-304ca6600e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21529e06-bbe8-4751-8ff5-304ca6600e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc6758a-49aa-40aa-b337-2127b9deac3c', 'volume_name': 'volume-6cc6758a-49aa-40aa-b337-2127b9deac3c', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5775d1b-534a-43e6-8ab8-a9b998692a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5775d1b-534a-43e6-8ab8-a9b998692a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b5b4478-9235-467a-aa63-f4c0e3988191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:31 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Volume 6cc6758a-49aa-40aa-b337-2127b9deac3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc6758a-49aa-40aa-b337-2127b9deac3c', 'volume_size': 1}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:31 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14" returned: 0 in 0.460s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.003s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1847350255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376881df-3421-4526-b0e2-d26c44851390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f6c9328bfd480fb41f6481ba90b6f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:30Z,use_quota=True,user_id='130aec3c2a3442fbb349e63d114fd693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Creating volume 376881df-3421-4526-b0e2-d26c44851390 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:04:31 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-376881df-3421-4526-b0e2-d26c44851390 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c926d90-75a0-4419-bf99-43d23958d8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:31 devstack sudo[89644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-376881df-3421-4526-b0e2-d26c44851390 1073741824
Apr 24 20:04:31 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214cbaf6-5466-40a8-b518-192024378ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:31 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Volume volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14 (f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14): created successfully
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214cbaf6-5466-40a8-b518-192024378ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Flow 'volume_create_manager' (09bcfb2f-6a32-4335-816e-219d59860447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:31 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-01e8b1de-3c34-46db-8d5d-3e5089df75f4 tempest-CreateVolumesFromImageTest-1430914625 None] Created volume successfully.
Apr 24 20:04:31 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-376881df-3421-4526-b0e2-d26c44851390 1073741824" returned: 0 in 0.567s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-376881df-3421-4526-b0e2-d26c44851390 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:31 devstack sudo[89649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-376881df-3421-4526-b0e2-d26c44851390
Apr 24 20:04:31 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:32 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-376881df-3421-4526-b0e2-d26c44851390" returned: 0 in 0.440s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.802s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-482409939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed6577f-c5e2-4435-9d2a-746902028626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f6c9328bfd480fb41f6481ba90b6f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:30Z,use_quota=True,user_id='130aec3c2a3442fbb349e63d114fd693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Creating volume 0ed6577f-c5e2-4435-9d2a-746902028626 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:04:32 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0ed6577f-c5e2-4435-9d2a-746902028626 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fd25cc-0682-4103-8e2d-40d10b8b0789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376881df-3421-4526-b0e2-d26c44851390', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee5e58d-e0da-42d7-a00f-8dec4c60bbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:32 devstack sudo[89652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0ed6577f-c5e2-4435-9d2a-746902028626 1073741824
Apr 24 20:04:32 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:32 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Volume volume-376881df-3421-4526-b0e2-d26c44851390 (376881df-3421-4526-b0e2-d26c44851390): created successfully
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee5e58d-e0da-42d7-a00f-8dec4c60bbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Flow 'volume_create_manager' (678ba7ca-6c7f-4e5d-a1c8-c36cf7fae03a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:32 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-ce385c0b-455e-4e6e-92ab-42a0a7eb0797 tempest-CreateVolumesFromImageTest-1430914625 None] Created volume successfully.
Apr 24 20:04:32 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0ed6577f-c5e2-4435-9d2a-746902028626 1073741824" returned: 0 in 0.573s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0ed6577f-c5e2-4435-9d2a-746902028626 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:32 devstack sudo[89657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0ed6577f-c5e2-4435-9d2a-746902028626
Apr 24 20:04:32 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:33 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0ed6577f-c5e2-4435-9d2a-746902028626" returned: 0 in 0.421s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.561s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1159346245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f2546c-2694-4a3f-8795-6b9b96cc594d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f6c9328bfd480fb41f6481ba90b6f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:31Z,use_quota=True,user_id='130aec3c2a3442fbb349e63d114fd693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Creating volume f9f2546c-2694-4a3f-8795-6b9b96cc594d {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:04:33 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a00e46-12b4-42e5-9593-7ddfe1dc2e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed6577f-c5e2-4435-9d2a-746902028626', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:33 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d 1073741824
Apr 24 20:04:33 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e2119a-f5f1-42e9-8e17-7e1459225a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:33 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Volume volume-0ed6577f-c5e2-4435-9d2a-746902028626 (0ed6577f-c5e2-4435-9d2a-746902028626): created successfully
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e2119a-f5f1-42e9-8e17-7e1459225a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Flow 'volume_create_manager' (e1836aec-5429-42fc-9fb7-8ebc2af875d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:33 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-24ebc96d-4bcc-4bc7-b476-c24726ba334c tempest-CreateVolumesFromImageTest-1430914625 None] Created volume successfully.
Apr 24 20:04:33 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d 1073741824" returned: 0 in 0.581s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:34 devstack sudo[89665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d
Apr 24 20:04:34 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:34 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d" returned: 0 in 0.443s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.399s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-798177717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc6758a-49aa-40aa-b337-2127b9deac3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f6c9328bfd480fb41f6481ba90b6f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:31Z,use_quota=True,user_id='130aec3c2a3442fbb349e63d114fd693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Creating volume 6cc6758a-49aa-40aa-b337-2127b9deac3c {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:04:34 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-6cc6758a-49aa-40aa-b337-2127b9deac3c 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3469bd3a-788e-465b-b030-50663bc7056f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:34 devstack sudo[89668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-6cc6758a-49aa-40aa-b337-2127b9deac3c 1073741824
Apr 24 20:04:34 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91bfa35e-7e1a-4887-bf5d-dab777a308b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:34 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Volume volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d (f9f2546c-2694-4a3f-8795-6b9b96cc594d): created successfully
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91bfa35e-7e1a-4887-bf5d-dab777a308b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Flow 'volume_create_manager' (06dbbd28-2eb3-4d70-a263-05f4f8214639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:34 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e30f0eac-d5ce-4eda-8d23-1b576dee61e4 tempest-CreateVolumesFromImageTest-1430914625 None] Created volume successfully.
Apr 24 20:04:35 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-6cc6758a-49aa-40aa-b337-2127b9deac3c 1073741824" returned: 0 in 0.593s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-6cc6758a-49aa-40aa-b337-2127b9deac3c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:35 devstack sudo[89673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-6cc6758a-49aa-40aa-b337-2127b9deac3c
Apr 24 20:04:35 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:35 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-6cc6758a-49aa-40aa-b337-2127b9deac3c" returned: 0 in 0.436s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:04:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b5b4478-9235-467a-aa63-f4c0e3988191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc6758a-49aa-40aa-b337-2127b9deac3c', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1ff0f8-ebfc-4b16-9493-9c6992cc5ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:35 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Volume volume-6cc6758a-49aa-40aa-b337-2127b9deac3c (6cc6758a-49aa-40aa-b337-2127b9deac3c): created successfully
Apr 24 20:04:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1ff0f8-ebfc-4b16-9493-9c6992cc5ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Flow 'volume_create_manager' (33837271-26be-45f9-8ea9-4ca2c11f324e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:35 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-3b4d211b-44b0-4070-abef-c6696d77de62 tempest-CreateVolumesFromImageTest-1430914625 None] Created volume successfully.
Apr 24 20:04:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "cinder-6cc6758a-49aa-40aa-b337-2127b9deac3c-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-6cc6758a-49aa-40aa-b337-2127b9deac3c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "cinder-quobyte-6cc6758a-49aa-40aa-b337-2127b9deac3c" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-quobyte-6cc6758a-49aa-40aa-b337-2127b9deac3c" acquired by "delete_volume" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:36 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda0f775-ba1f-48b0-8e0d-214925681173]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-6cc6758a-49aa-40aa-b337-2127b9deac3c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:36 devstack sudo[89676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-6cc6758a-49aa-40aa-b337-2127b9deac3c
Apr 24 20:04:36 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:37 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-6cc6758a-49aa-40aa-b337-2127b9deac3c" returned: 0 in 0.497s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-6cc6758a-49aa-40aa-b337-2127b9deac3c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:37 devstack sudo[89681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-6cc6758a-49aa-40aa-b337-2127b9deac3c
Apr 24 20:04:37 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:37 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-6cc6758a-49aa-40aa-b337-2127b9deac3c" returned: 0 in 0.414s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:37 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-quobyte-6cc6758a-49aa-40aa-b337-2127b9deac3c" released by "delete_volume" :: held 0.968s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:37 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Created reservations ['9961d186-0cf1-4121-9c18-fcedecf9a346', '91e7d1f0-245f-4c0a-b868-0633bb9a74ab', '49876dbf-1c5a-4631-a85c-f4787566945f', 'fc5a9a82-193d-4908-a095-b15b1b38a7ee'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:04:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:37 devstack sudo[89684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:04:37 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:38 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.419s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:38 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:04:38 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Deleted volume successfully.
Apr 24 20:04:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-2dc42be3-9282-4381-933f-ac1a82180901 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-6cc6758a-49aa-40aa-b337-2127b9deac3c-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "cinder-f9f2546c-2694-4a3f-8795-6b9b96cc594d-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-f9f2546c-2694-4a3f-8795-6b9b96cc594d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "cinder-quobyte-f9f2546c-2694-4a3f-8795-6b9b96cc594d" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-quobyte-f9f2546c-2694-4a3f-8795-6b9b96cc594d" acquired by "delete_volume" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:38 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a47ea5-90cc-4156-9f50-debeb7d4a11c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:38 devstack sudo[89687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d
Apr 24 20:04:38 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:39 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d" returned: 0 in 0.505s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:39 devstack sudo[89693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d
Apr 24 20:04:39 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:39 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f9f2546c-2694-4a3f-8795-6b9b96cc594d" returned: 0 in 0.420s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-quobyte-f9f2546c-2694-4a3f-8795-6b9b96cc594d" released by "delete_volume" :: held 0.969s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:39 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Created reservations ['4e587bb5-1340-437c-adab-6633c288f549', '5be453c5-df77-442c-b0bd-653617f2f56a', '2e0d2893-6f56-4a77-9574-b5cc29d29b16', '01589470-c808-4c10-8477-6d9ace4eccb5'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:04:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:39 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:04:39 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:40 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.431s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:40 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:04:40 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Deleted volume successfully.
Apr 24 20:04:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e55d3ed8-a1fd-44c2-94f8-2c19937000f6 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-f9f2546c-2694-4a3f-8795-6b9b96cc594d-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "cinder-0ed6577f-c5e2-4435-9d2a-746902028626-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-0ed6577f-c5e2-4435-9d2a-746902028626-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "cinder-quobyte-0ed6577f-c5e2-4435-9d2a-746902028626" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-quobyte-0ed6577f-c5e2-4435-9d2a-746902028626" acquired by "delete_volume" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:41 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1716b930-a06d-4304-8c9b-552575a90168]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0ed6577f-c5e2-4435-9d2a-746902028626 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:41 devstack sudo[89733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0ed6577f-c5e2-4435-9d2a-746902028626
Apr 24 20:04:41 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:41 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0ed6577f-c5e2-4435-9d2a-746902028626" returned: 0 in 0.517s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0ed6577f-c5e2-4435-9d2a-746902028626 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:41 devstack sudo[89738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0ed6577f-c5e2-4435-9d2a-746902028626
Apr 24 20:04:41 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:41 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0ed6577f-c5e2-4435-9d2a-746902028626" returned: 0 in 0.421s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-quobyte-0ed6577f-c5e2-4435-9d2a-746902028626" released by "delete_volume" :: held 0.974s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:42 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Created reservations ['65c47a47-2a5d-498f-904b-8f0d7cdc45e5', '8d1fdc15-abfa-4626-818b-e1ef4e10a349', 'e738f88b-ac83-497b-b687-be78473970dd', 'c7f0d559-7afa-431e-a09e-82fc029c09ab'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:04:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:42 devstack sudo[89741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:04:42 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:42 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.424s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:42 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:04:42 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Deleted volume successfully.
Apr 24 20:04:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f8e5882f-e733-4b43-9c48-47439ea308c5 tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-0ed6577f-c5e2-4435-9d2a-746902028626-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "cinder-376881df-3421-4526-b0e2-d26c44851390-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-376881df-3421-4526-b0e2-d26c44851390-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "cinder-quobyte-376881df-3421-4526-b0e2-d26c44851390" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-quobyte-376881df-3421-4526-b0e2-d26c44851390" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:43 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee396b2b-1929-4b95-955f-54dd86806300]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-376881df-3421-4526-b0e2-d26c44851390 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:43 devstack sudo[89744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-376881df-3421-4526-b0e2-d26c44851390
Apr 24 20:04:43 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:43 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-376881df-3421-4526-b0e2-d26c44851390" returned: 0 in 0.484s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-376881df-3421-4526-b0e2-d26c44851390 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:43 devstack sudo[89749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-376881df-3421-4526-b0e2-d26c44851390
Apr 24 20:04:43 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:44 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-376881df-3421-4526-b0e2-d26c44851390" returned: 0 in 0.419s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-quobyte-376881df-3421-4526-b0e2-d26c44851390" released by "delete_volume" :: held 0.940s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Created reservations ['27d612da-744e-442f-9a54-0d4031c0e071', '57354830-ed18-4292-b878-e6b96da56470', 'a22d6eea-4dd1-4b14-9560-cad6c0888b71', '1c1463fe-05ee-4d9c-aa6f-be07fb6baf7c'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:44 devstack sudo[89752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:04:44 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "cinder-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "cinder-quobyte-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-quobyte-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14" acquired by "delete_volume" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[888f199b-e28d-4baa-b8ca-41d654124b20]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:44 devstack sudo[89754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14
Apr 24 20:04:44 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:44 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.454s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:04:44 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Deleted volume successfully.
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-207f58fa-3e28-4542-b63c-940f9ba5991d tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-376881df-3421-4526-b0e2-d26c44851390-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:44 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14" returned: 0 in 0.520s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:44 devstack sudo[89760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14
Apr 24 20:04:44 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:45 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14" returned: 0 in 0.422s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-quobyte-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14" released by "delete_volume" :: held 0.977s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:45 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Created reservations ['feba24cd-5241-482d-993d-983c66a80660', 'c44770e4-1c3c-4488-8c5f-8572effa8207', 'd1ee1dbd-ee1a-4681-a063-88e11e38ef9a', '861dddd2-5fa2-4612-8b8a-baf7a36f49ce'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:04:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:45 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:45 devstack sudo[89763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:04:45 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:45 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.427s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:45 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:04:45 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Deleted volume successfully.
Apr 24 20:04:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b070f0f7-0030-455d-b625-3ed91c8b06ea tempest-CreateVolumesFromImageTest-1430914625 None] Lock "cinder-f8b2c2c8-2dcf-4cd7-a47b-988dd632cf14-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:UPDATE=103,cinder:DELETE=12,cinder:SELECT=80,cinder:INSERT=26 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=91,cinder:INSERT=32,cinder:UPDATE=135,cinder:DELETE=9 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Flow 'volume_create_manager' (246993fa-cdc5-47aa-9ef5-0df2bb07d6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3ade1b-a684-49f9-907e-738b68789453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3ade1b-a684-49f9-907e-738b68789453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1668546674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44c697d-23ac-45f4-9ac4-154306974622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a97da925101446695acd498b2164298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:49Z,use_quota=True,user_id='d35006f6ce884b80a0d59bc9756d5562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d2b554-e5cb-49e2-92a2-7965b839115e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d2b554-e5cb-49e2-92a2-7965b839115e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68e9304-4f55-42e3-949b-423ee17a4532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68e9304-4f55-42e3-949b-423ee17a4532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b44c697d-23ac-45f4-9ac4-154306974622', 'volume_name': 'volume-b44c697d-23ac-45f4-9ac4-154306974622', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39fec40f-159d-4918-b418-6b76a33319ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39fec40f-159d-4918-b418-6b76a33319ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89006f37-a057-402a-88b8-9388ce248078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:48 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Volume b44c697d-23ac-45f4-9ac4-154306974622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b44c697d-23ac-45f4-9ac4-154306974622', 'volume_size': 1}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1668546674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44c697d-23ac-45f4-9ac4-154306974622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a97da925101446695acd498b2164298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:49Z,use_quota=True,user_id='d35006f6ce884b80a0d59bc9756d5562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Creating volume b44c697d-23ac-45f4-9ac4-154306974622 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:04:48 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:04:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:48 devstack sudo[89766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622 1073741824
Apr 24 20:04:48 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:49 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622 1073741824" returned: 0 in 0.598s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:49 devstack sudo[89772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622
Apr 24 20:04:49 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:49 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622" returned: 0 in 0.430s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:04:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89006f37-a057-402a-88b8-9388ce248078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b44c697d-23ac-45f4-9ac4-154306974622', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7352af-f379-4933-815d-ee0967f1cf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:50 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Volume volume-b44c697d-23ac-45f4-9ac4-154306974622 (b44c697d-23ac-45f4-9ac4-154306974622): created successfully
Apr 24 20:04:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7352af-f379-4933-815d-ee0967f1cf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Flow 'volume_create_manager' (246993fa-cdc5-47aa-9ef5-0df2bb07d6eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:50 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b42b770a-0d8b-476b-86a7-f44d7b8743a4 tempest-VolumeDependencyTests-1546287759 None] Created volume successfully.
Apr 24 20:04:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] Creating offline snapshot 57f7912d-0aa7-4184-ab64-09477d064ba8 of volume b44c697d-23ac-45f4-9ac4-154306974622 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:04:51 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d958b3-4b39-4ccb-b650-4b26e1873b77]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:51 devstack sudo[89775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622
Apr 24 20:04:51 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:51 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622" returned: 0 in 0.500s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:51 devstack sudo[89780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8 1G
Apr 24 20:04:51 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:52 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8 1G" returned: 0 in 0.591s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44c697d-23ac-45f4-9ac4-154306974622 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:52 devstack sudo[89785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44c697d-23ac-45f4-9ac4-154306974622 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8
Apr 24 20:04:52 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:52 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44c697d-23ac-45f4-9ac4-154306974622 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8" returned: 0 in 0.464s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:52 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8 is being set with open permissions: ugo+rw
Apr 24 20:04:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:52 devstack sudo[89790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8
Apr 24 20:04:52 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:53 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8" returned: 0 in 0.422s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:53 devstack sudo[89793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.info
Apr 24 20:04:53 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:53 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.info" returned: 0 in 0.420s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:53 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.info is being set with open permissions: ugo+rw
Apr 24 20:04:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:53 devstack sudo[89796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.info
Apr 24 20:04:53 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:54 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.info" returned: 0 in 0.424s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.926s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:54 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-2d0d5e7c-3f6a-4cd5-a102-766dc3998591 tempest-VolumeDependencyTests-1546287759 None] Create snapshot completed successfully
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Flow 'volume_create_manager' (6a26e757-fec3-4036-bcf4-399b854a4865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c8d01a-10df-4dde-9dfe-eb2717adfdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c8d01a-10df-4dde-9dfe-eb2717adfdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1602812147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe62437-d02d-408e-82ae-741ae5b04446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a97da925101446695acd498b2164298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=57f7912d-0aa7-4184-ab64-09477d064ba8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:04:55Z,use_quota=True,user_id='d35006f6ce884b80a0d59bc9756d5562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a375406d-baef-43b3-949a-499c8f9ff432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a375406d-baef-43b3-949a-499c8f9ff432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e385ceed-c7df-40c9-8a5a-8d6c4c19cfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e385ceed-c7df-40c9-8a5a-8d6c4c19cfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dbe62437-d02d-408e-82ae-741ae5b04446', 'volume_name': 'volume-dbe62437-d02d-408e-82ae-741ae5b04446', 'volume_size': 1, 'snapshot_id': '57f7912d-0aa7-4184-ab64-09477d064ba8'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dc9958-1b34-470c-92b4-cad8d9721e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dc9958-1b34-470c-92b4-cad8d9721e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fea75a-6ba5-4038-9ab1-464ba4dcfef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:04:54 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Volume dbe62437-d02d-408e-82ae-741ae5b04446: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dbe62437-d02d-408e-82ae-741ae5b04446', 'volume_size': 1, 'snapshot_id': '57f7912d-0aa7-4184-ab64-09477d064ba8'}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-quobyte-57f7912d-0aa7-4184-ab64-09477d064ba8-dbe62437-d02d-408e-82ae-741ae5b04446" by "_create_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-57f7912d-0aa7-4184-ab64-09477d064ba8-dbe62437-d02d-408e-82ae-741ae5b04446" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Creating volume dbe62437-d02d-408e-82ae-741ae5b04446 from snapshot 57f7912d-0aa7-4184-ab64-09477d064ba8 {{(pid=81241) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-quobyte-dbe62437-d02d-408e-82ae-741ae5b04446" by "_copy_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-dbe62437-d02d-408e-82ae-741ae5b04446" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] snapshot: 57f7912d-0aa7-4184-ab64-09477d064ba8, volume: dbe62437-d02d-408e-82ae-741ae5b04446,  {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d5ca4d-3438-4758-ba5f-11dcd8ebb7cb]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:54 devstack sudo[89799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8
Apr 24 20:04:54 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:55 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8" returned: 0 in 0.518s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b44c697d-23ac-45f4-9ac4-154306974622(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:04:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622 {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 20:04:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Creating direct copy from snapshot {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 20:04:55 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb086b5-8b35-407b-8953-d53608d8735c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:04:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:55 devstack sudo[89804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622
Apr 24 20:04:55 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:04:55 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root
Apr 24 20:04:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622" returned: 0 in 0.501s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:04:55 devstack cinder-volume[81241]: DEBUG cinder.utils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Path /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446 not found in is_blk_device check {{(pid=81241) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 20:04:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:04:55 devstack sudo[89809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446
Apr 24 20:04:55 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:00 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446" returned: 0 in 4.282s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:00 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[055ec544-2596-4893-8b67-67bc533e5df8]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:00 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622
Apr 24 20:05:00 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:00 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622" returned: 0 in 0.634s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:00 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622, size 1024.00 MB, duration 4.28 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446 {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 20:05:00 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Converted 1024.00 MB image at 239.07 MB/s
Apr 24 20:05:00 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446 is being set with open permissions: ugo+rw
Apr 24 20:05:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:00 devstack sudo[89827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446
Apr 24 20:05:00 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:01 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446" returned: 0 in 0.460s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:01 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-dbe62437-d02d-408e-82ae-741ae5b04446" released by "_copy_volume_from_snapshot" :: held 6.479s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:01 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-57f7912d-0aa7-4184-ab64-09477d064ba8-dbe62437-d02d-408e-82ae-741ae5b04446" released by "_create_volume_from_snapshot" :: held 6.505s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.520s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fea75a-6ba5-4038-9ab1-464ba4dcfef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe62437-d02d-408e-82ae-741ae5b04446', 'volume_size': 1, 'snapshot_id': '57f7912d-0aa7-4184-ab64-09477d064ba8'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2038b6fc-dab7-492c-8360-fc9803e1b19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:01 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Volume volume-dbe62437-d02d-408e-82ae-741ae5b04446 (dbe62437-d02d-408e-82ae-741ae5b04446): created successfully
Apr 24 20:05:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2038b6fc-dab7-492c-8360-fc9803e1b19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:01 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Flow 'volume_create_manager' (6a26e757-fec3-4036-bcf4-399b854a4865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:05:01 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-900033f7-ff6d-4eff-967c-8d138ea50036 tempest-VolumeDependencyTests-1546287759 None] Created volume successfully.
Apr 24 20:05:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-57f7912d-0aa7-4184-ab64-09477d064ba8-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-57f7912d-0aa7-4184-ab64-09477d064ba8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-quobyte-b44c697d-23ac-45f4-9ac4-154306974622" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-b44c697d-23ac-45f4-9ac4-154306974622" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-quobyte-57f7912d-0aa7-4184-ab64-09477d064ba8" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-57f7912d-0aa7-4184-ab64-09477d064ba8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Deleting offline snapshot 57f7912d-0aa7-4184-ab64-09477d064ba8 of volume b44c697d-23ac-45f4-9ac4-154306974622 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:05:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] snapshot_file for this snap is: volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:05:02 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fccb4c-e0ca-4d0e-97e5-444a08801887]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:02 devstack sudo[89830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8
Apr 24 20:05:02 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:02 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8" returned: 0 in 0.534s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:02 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b44c697d-23ac-45f4-9ac4-154306974622(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:05:02 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a23ff86-539f-4c56-86fe-e1a888a92cfd]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:03 devstack sudo[89835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622
Apr 24 20:05:03 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:03 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622" returned: 0 in 0.517s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:03 devstack sudo[89840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8
Apr 24 20:05:03 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:03 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8" returned: 0 in 0.518s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:04 devstack sudo[89845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8
Apr 24 20:05:04 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:04 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622.57f7912d-0aa7-4184-ab64-09477d064ba8" returned: 0 in 0.441s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-57f7912d-0aa7-4184-ab64-09477d064ba8" released by "_delete_snapshot" :: held 2.111s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-b44c697d-23ac-45f4-9ac4-154306974622" released by "delete_snapshot" :: held 2.133s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:04 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Created reservations ['344c97b9-eb5b-41d8-99ef-c5bfdfcf4740', 'c5e004d3-abd8-49bf-91ed-b4804616a647', '3a061f94-328e-407a-9dd4-de0d9a5cb213', '2879a2b8-62f3-48b3-a501-80d5a24419a6'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:05:04 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Delete snapshot completed successfully.
Apr 24 20:05:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab894170-1d6d-4b59-a41f-45208465fd4f tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-57f7912d-0aa7-4184-ab64-09477d064ba8-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-b44c697d-23ac-45f4-9ac4-154306974622-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-b44c697d-23ac-45f4-9ac4-154306974622-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-quobyte-b44c697d-23ac-45f4-9ac4-154306974622" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-b44c697d-23ac-45f4-9ac4-154306974622" acquired by "delete_volume" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:05 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[32efed1c-83cc-40c6-9c0b-31368beaf0e5]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:05 devstack sudo[89848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622
Apr 24 20:05:05 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:06 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622" returned: 0 in 0.517s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:06 devstack sudo[89853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622
Apr 24 20:05:06 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:06 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b44c697d-23ac-45f4-9ac4-154306974622" returned: 0 in 0.454s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-b44c697d-23ac-45f4-9ac4-154306974622" released by "delete_volume" :: held 1.027s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:06 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Created reservations ['2fca695e-cea8-4fc2-8603-db4e03ef2e42', 'fbe092dd-38cb-4455-a228-79566718f2c0', 'eb45fd31-bd72-4b83-bdcb-6f3efbc3f5ee', 'f9aee22c-4535-43e9-9b20-40e3265a416e'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:05:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:05:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:05:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:06 devstack sudo[89856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:05:06 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:07 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.444s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:07 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:05:07 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Deleted volume successfully.
Apr 24 20:05:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-e4fddadb-1cbc-4edd-9829-b463f43aa68e tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-b44c697d-23ac-45f4-9ac4-154306974622-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:07 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:05:07 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Flow 'volume_create_manager' (d49374a9-5734-498d-ab6c-fbc43b91be69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5d44da-c9d2-4c9d-bdcc-f02736906d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5d44da-c9d2-4c9d-bdcc-f02736906d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-14387199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323f6fc9-3581-4ee0-8c9b-09e06664c04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a97da925101446695acd498b2164298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:05:08Z,use_quota=True,user_id='d35006f6ce884b80a0d59bc9756d5562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e075a1f5-2f98-41fe-9412-12f58dab81aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e075a1f5-2f98-41fe-9412-12f58dab81aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b88475-5082-4eb4-b805-e14ec256fa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b88475-5082-4eb4-b805-e14ec256fa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '323f6fc9-3581-4ee0-8c9b-09e06664c04b', 'volume_name': 'volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52f2fa3-8b16-49d0-97f5-b00a7727a5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52f2fa3-8b16-49d0-97f5-b00a7727a5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc46ed5-5ae5-4657-9b39-50d88c8dc483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:08 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Volume 323f6fc9-3581-4ee0-8c9b-09e06664c04b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b', 'volume_size': 1}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-14387199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323f6fc9-3581-4ee0-8c9b-09e06664c04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a97da925101446695acd498b2164298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:05:08Z,use_quota=True,user_id='d35006f6ce884b80a0d59bc9756d5562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Creating volume 323f6fc9-3581-4ee0-8c9b-09e06664c04b {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:05:08 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:08 devstack sudo[89859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b 1073741824
Apr 24 20:05:08 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:08 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b 1073741824" returned: 0 in 0.596s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:08 devstack sudo[89864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b
Apr 24 20:05:08 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:09 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b" returned: 0 in 0.445s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:05:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc46ed5-5ae5-4657-9b39-50d88c8dc483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea733a0-6eb8-4ed9-aeb5-c5cecc28a080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:09 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Volume volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b (323f6fc9-3581-4ee0-8c9b-09e06664c04b): created successfully
Apr 24 20:05:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea733a0-6eb8-4ed9-aeb5-c5cecc28a080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Flow 'volume_create_manager' (d49374a9-5734-498d-ab6c-fbc43b91be69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:05:09 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-841e0a9d-8794-45d6-bcb8-0b20f10143cb tempest-VolumeDependencyTests-1546287759 None] Created volume successfully.
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Flow 'volume_create_manager' (17221cfd-0afb-4300-9c9f-178b6a0e6f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e32553-3b87-4547-90cf-d8215c1a4f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e32553-3b87-4547-90cf-d8215c1a4f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-591660370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb59afc-4956-47a1-8adb-51e84e4f7fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a97da925101446695acd498b2164298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=323f6fc9-3581-4ee0-8c9b-09e06664c04b,status='creating',terminated_at=None,updated_at=2026-04-24T18:05:10Z,use_quota=True,user_id='d35006f6ce884b80a0d59bc9756d5562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e4a2ec-7064-46b5-9e1e-46f9ce0af8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e4a2ec-7064-46b5-9e1e-46f9ce0af8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea475db1-0b9b-468f-abf7-d8c0b03cd167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea475db1-0b9b-468f-abf7-d8c0b03cd167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2fb59afc-4956-47a1-8adb-51e84e4f7fae', 'volume_name': 'volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae', 'volume_size': 1, 'source_volid': '323f6fc9-3581-4ee0-8c9b-09e06664c04b', 'source_volstatus': 'available'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b413e64f-00e8-4e9f-a867-726302d5360c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b413e64f-00e8-4e9f-a867-726302d5360c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b2e0e4-6e9c-4a73-91dd-2c39c7489488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:10 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Volume 2fb59afc-4956-47a1-8adb-51e84e4f7fae: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae', 'volume_size': 1, 'source_volid': '323f6fc9-3581-4ee0-8c9b-09e06664c04b', 'source_volstatus': 'available'}
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:10 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Cloning volume 323f6fc9-3581-4ee0-8c9b-09e06664c04b to volume 2fb59afc-4956-47a1-8adb-51e84e4f7fae
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Creating offline snapshot 6c604169-db6f-4653-ae35-4e7ae7ae307c of volume 323f6fc9-3581-4ee0-8c9b-09e06664c04b {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8d7de5-01c1-4411-aa9d-4d7f20aec395]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:10 devstack sudo[89868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b
Apr 24 20:05:10 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:11 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b" returned: 0 in 0.508s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:11 devstack sudo[89873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c 1G
Apr 24 20:05:11 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:11 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c 1G" returned: 0 in 0.610s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:11 devstack sudo[89878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c
Apr 24 20:05:11 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:12 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c" returned: 0 in 0.495s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:12 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c is being set with open permissions: ugo+rw
Apr 24 20:05:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:12 devstack sudo[89883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c
Apr 24 20:05:12 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:12 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c" returned: 0 in 0.456s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:12 devstack sudo[89886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.info
Apr 24 20:05:12 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:13 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.info" returned: 0 in 0.453s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:13 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.info is being set with open permissions: ugo+rw
Apr 24 20:05:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:13 devstack sudo[89889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.info
Apr 24 20:05:13 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:13 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.info" returned: 0 in 0.445s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:13 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-quobyte-2fb59afc-4956-47a1-8adb-51e84e4f7fae" by "_copy_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:13 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-2fb59afc-4956-47a1-8adb-51e84e4f7fae" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] snapshot: 6c604169-db6f-4653-ae35-4e7ae7ae307c, volume: 2fb59afc-4956-47a1-8adb-51e84e4f7fae,  {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 20:05:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:05:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:05:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:13 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab5208b-9182-433c-a998-8662d022fedf]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:13 devstack sudo[89892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c
Apr 24 20:05:13 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:14 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c" returned: 0 in 0.535s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:14 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:05:14 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 20:05:14 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Creating direct copy from snapshot {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 20:05:14 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[25660612-92c4-4a5f-9cc3-65c888656745]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:14 devstack sudo[89897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b
Apr 24 20:05:14 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:14 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b" returned: 0 in 0.531s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:14 devstack cinder-volume[81241]: DEBUG cinder.utils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Path /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae not found in is_blk_device check {{(pid=81241) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 20:05:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:14 devstack sudo[89902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae
Apr 24 20:05:14 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:19 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae" returned: 0 in 4.675s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:19 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ce44fb-aa56-4391-86f7-df5b3094aa26]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:19 devstack sudo[89922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b
Apr 24 20:05:19 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:20 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b" returned: 0 in 0.644s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:20 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b, size 1024.00 MB, duration 4.68 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 20:05:20 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Converted 1024.00 MB image at 218.99 MB/s
Apr 24 20:05:20 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae is being set with open permissions: ugo+rw
Apr 24 20:05:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:20 devstack sudo[89927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae
Apr 24 20:05:20 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:20 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae" returned: 0 in 0.436s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-2fb59afc-4956-47a1-8adb-51e84e4f7fae" released by "_copy_volume_from_snapshot" :: held 6.907s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-quobyte-6c604169-db6f-4653-ae35-4e7ae7ae307c" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-6c604169-db6f-4653-ae35-4e7ae7ae307c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Deleting offline snapshot 6c604169-db6f-4653-ae35-4e7ae7ae307c of volume 323f6fc9-3581-4ee0-8c9b-09e06664c04b {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:05:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] snapshot_file for this snap is: volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:05:20 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b57805f-dd3e-4e00-86d6-de42f921cec7]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:20 devstack sudo[89930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c
Apr 24 20:05:20 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:21 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c" returned: 0 in 0.513s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:21 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:05:21 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[29174cbf-5a85-4922-9748-9808516e9f11]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:21 devstack sudo[89935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b
Apr 24 20:05:21 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:21 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b" returned: 0 in 0.517s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:21 devstack sudo[89940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c
Apr 24 20:05:21 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:22 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c" returned: 0 in 0.520s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:22 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c
Apr 24 20:05:22 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:22 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b.6c604169-db6f-4653-ae35-4e7ae7ae307c" returned: 0 in 0.415s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:22 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-6c604169-db6f-4653-ae35-4e7ae7ae307c" released by "_delete_snapshot" :: held 2.055s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.098s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b2e0e4-6e9c-4a73-91dd-2c39c7489488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae', 'volume_size': 1, 'source_volid': '323f6fc9-3581-4ee0-8c9b-09e06664c04b', 'source_volstatus': 'available'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af59f02e-c6ff-4fc1-b89f-d0e77caad973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:22 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Volume volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae (2fb59afc-4956-47a1-8adb-51e84e4f7fae): created successfully
Apr 24 20:05:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af59f02e-c6ff-4fc1-b89f-d0e77caad973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:22 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Flow 'volume_create_manager' (17221cfd-0afb-4300-9c9f-178b6a0e6f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:05:22 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-518f1186-5aad-420d-98c5-a21a6f2fc7ad tempest-VolumeDependencyTests-1546287759 None] Created volume successfully.
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-323f6fc9-3581-4ee0-8c9b-09e06664c04b-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-323f6fc9-3581-4ee0-8c9b-09e06664c04b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-quobyte-323f6fc9-3581-4ee0-8c9b-09e06664c04b" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-323f6fc9-3581-4ee0-8c9b-09e06664c04b" acquired by "delete_volume" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dfed00-a85e-4dc9-a524-ca5bd480cca7]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:23 devstack sudo[89950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b
Apr 24 20:05:23 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:23 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b" returned: 0 in 0.495s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:24 devstack sudo[89955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:05:24 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:24 devstack sudo[89956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b
Apr 24 20:05:24 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:24 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.433s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:24 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:05:24 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-323f6fc9-3581-4ee0-8c9b-09e06664c04b" returned: 0 in 0.431s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-323f6fc9-3581-4ee0-8c9b-09e06664c04b" released by "delete_volume" :: held 0.979s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:24 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Created reservations ['7be2767e-273d-4639-bcb2-5a48fe15dd83', 'fcc5f474-72ff-4002-8ee8-e73cc3e9c6f1', 'a0024ace-0632-4c11-a80f-57a744d3c429', '3a66dc58-3bd2-4db5-975b-890a039bee99'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:05:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:05:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:05:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:24 devstack sudo[89961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:05:24 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:24 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.419s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:24 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:05:24 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Deleted volume successfully.
Apr 24 20:05:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-43038d75-b180-47c5-a1f6-0c15bb104370 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-323f6fc9-3581-4ee0-8c9b-09e06664c04b-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-2fb59afc-4956-47a1-8adb-51e84e4f7fae-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-2fb59afc-4956-47a1-8adb-51e84e4f7fae-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-quobyte-2fb59afc-4956-47a1-8adb-51e84e4f7fae" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-2fb59afc-4956-47a1-8adb-51e84e4f7fae" acquired by "delete_volume" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:25 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[112b4acb-7098-4b87-b11f-b56eb39859a3]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:25 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae
Apr 24 20:05:25 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:26 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae" returned: 0 in 0.504s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:26 devstack sudo[89969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae
Apr 24 20:05:26 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:26 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-2fb59afc-4956-47a1-8adb-51e84e4f7fae" returned: 0 in 0.423s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-2fb59afc-4956-47a1-8adb-51e84e4f7fae" released by "delete_volume" :: held 0.964s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:26 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Created reservations ['5e1d9c1b-ade0-435f-b3d9-d6377522f3b2', 'a27cbc8c-448d-4f7f-bbe3-434e6cfebb0d', '5f71e8e4-d20c-4f06-8591-17235ac9f545', 'b0824474-2e7b-49fe-8639-141da46b38e2'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:05:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:05:26 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:05:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:26 devstack sudo[89972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:05:26 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:27 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.421s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:27 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:05:27 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Deleted volume successfully.
Apr 24 20:05:27 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-59247f9b-2d78-41a5-b985-8e3de8f3fa55 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-2fb59afc-4956-47a1-8adb-51e84e4f7fae-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:27 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-dbe62437-d02d-408e-82ae-741ae5b04446-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:27 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-dbe62437-d02d-408e-82ae-741ae5b04446-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:27 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "cinder-quobyte-dbe62437-d02d-408e-82ae-741ae5b04446" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:27 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-dbe62437-d02d-408e-82ae-741ae5b04446" acquired by "delete_volume" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:27 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be5f534-0e44-4293-ba30-0d2a95759908]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:28 devstack sudo[89975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446
Apr 24 20:05:28 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:28 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446" returned: 0 in 0.501s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:28 devstack sudo[89980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446
Apr 24 20:05:28 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:28 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-dbe62437-d02d-408e-82ae-741ae5b04446" returned: 0 in 0.465s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-quobyte-dbe62437-d02d-408e-82ae-741ae5b04446" released by "delete_volume" :: held 1.005s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:28 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Created reservations ['e015e02d-272f-4e38-ba0d-8937c2bccb12', '3e5b296f-589b-4e19-91bb-ca1b3eb5466b', 'ec799e77-6ee0-41e6-893e-acde9087dcda', '2960a1de-7b34-449c-978d-a2a809bb8022'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:05:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:05:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:05:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:29 devstack sudo[89983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:05:29 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:29 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.443s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:29 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:05:29 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Deleted volume successfully.
Apr 24 20:05:29 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d2b8664f-1884-4d83-8a23-43619c1dec17 tempest-VolumeDependencyTests-1546287759 None] Lock "cinder-dbe62437-d02d-408e-82ae-741ae5b04446-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:05:39 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=41,cinder:INSERT=17,cinder:UPDATE=55,cinder:DELETE=5 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:05:39 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=39,cinder:UPDATE=47,cinder:DELETE=4,cinder:INSERT=9 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Flow 'volume_create_manager' (038e9f0e-5ea5-41f7-a102-00b3d4057250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f85c47-b8a5-4c84-b6c8-475f6e08ad7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f85c47-b8a5-4c84-b6c8-475f6e08ad7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1101289304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65015e83-5c3b-4664-995a-9312ebd61f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ea071f998f4f8eb27809b7ca305a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:05:50Z,use_quota=True,user_id='176ff33f276b4afcb81df594055249e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d070f06-06c7-4b0f-933f-bf0b04c83b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d070f06-06c7-4b0f-933f-bf0b04c83b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba39032-bc1c-4a4e-af4b-73b19374afdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba39032-bc1c-4a4e-af4b-73b19374afdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65015e83-5c3b-4664-995a-9312ebd61f93', 'volume_name': 'volume-65015e83-5c3b-4664-995a-9312ebd61f93', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc420ae-724e-4e7c-bbbf-483317528ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc420ae-724e-4e7c-bbbf-483317528ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04e2e82-68d5-4ef1-a62e-dacb63e2f664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:49 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Volume 65015e83-5c3b-4664-995a-9312ebd61f93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65015e83-5c3b-4664-995a-9312ebd61f93', 'volume_size': 1}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1101289304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65015e83-5c3b-4664-995a-9312ebd61f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ea071f998f4f8eb27809b7ca305a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:05:50Z,use_quota=True,user_id='176ff33f276b4afcb81df594055249e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Creating volume 65015e83-5c3b-4664-995a-9312ebd61f93 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:05:49 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:05:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:49 devstack sudo[90025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93 1073741824
Apr 24 20:05:49 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:50 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93 1073741824" returned: 0 in 0.650s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:50 devstack sudo[90030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93
Apr 24 20:05:50 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:50 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93" returned: 0 in 0.451s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:05:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04e2e82-68d5-4ef1-a62e-dacb63e2f664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65015e83-5c3b-4664-995a-9312ebd61f93', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591d1446-37db-4a85-bcb7-a6e9de8d23ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:50 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Volume volume-65015e83-5c3b-4664-995a-9312ebd61f93 (65015e83-5c3b-4664-995a-9312ebd61f93): created successfully
Apr 24 20:05:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591d1446-37db-4a85-bcb7-a6e9de8d23ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:50 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Flow 'volume_create_manager' (038e9f0e-5ea5-41f7-a102-00b3d4057250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:05:50 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-75cefb98-fc8f-4ac4-887f-83896633902c tempest-SnapshotDependencyTests-1878803794 None] Created volume successfully.
Apr 24 20:05:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] Creating offline snapshot 47477d67-dc4a-4356-bf8e-b8731db6de1e of volume 65015e83-5c3b-4664-995a-9312ebd61f93 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:05:52 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b428e5c-485d-4c63-8213-c893355a0642]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:52 devstack sudo[90033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93
Apr 24 20:05:52 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:52 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93" returned: 0 in 0.507s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:52 devstack sudo[90038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e 1G
Apr 24 20:05:52 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:53 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e 1G" returned: 0 in 0.568s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65015e83-5c3b-4664-995a-9312ebd61f93 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:53 devstack sudo[90043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65015e83-5c3b-4664-995a-9312ebd61f93 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e
Apr 24 20:05:53 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:53 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65015e83-5c3b-4664-995a-9312ebd61f93 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e" returned: 0 in 0.459s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:53 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e is being set with open permissions: ugo+rw
Apr 24 20:05:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:53 devstack sudo[90048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e
Apr 24 20:05:53 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:54 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e" returned: 0 in 0.435s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:54 devstack sudo[90051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.info
Apr 24 20:05:54 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:54 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.info" returned: 0 in 0.461s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:54 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.info is being set with open permissions: ugo+rw
Apr 24 20:05:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:54 devstack sudo[90054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.info
Apr 24 20:05:54 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:54 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.info" returned: 0 in 0.432s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.963s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:55 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-dc9e2ade-44e6-4007-b50f-87b82628c145 tempest-SnapshotDependencyTests-1878803794 None] Create snapshot completed successfully
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Flow 'volume_create_manager' (2da08356-cc32-4ac7-ae75-d61c5ed9b4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3781df9b-9ee3-4ca6-9ca6-6c7316940686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3781df9b-9ee3-4ca6-9ca6-6c7316940686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d9cb51-d3cc-4fba-a686-c682208cf118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ea071f998f4f8eb27809b7ca305a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=47477d67-dc4a-4356-bf8e-b8731db6de1e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:05:56Z,use_quota=True,user_id='176ff33f276b4afcb81df594055249e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01457010-ae9e-43ad-b8b4-1806661c6813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01457010-ae9e-43ad-b8b4-1806661c6813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9a875c-c9fa-4e5c-a7c0-b2f5326c00ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9a875c-c9fa-4e5c-a7c0-b2f5326c00ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '57d9cb51-d3cc-4fba-a686-c682208cf118', 'volume_name': 'volume-57d9cb51-d3cc-4fba-a686-c682208cf118', 'volume_size': 1, 'snapshot_id': '47477d67-dc4a-4356-bf8e-b8731db6de1e'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f571e7c-4ec6-43c2-b5a1-4c9136361591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f571e7c-4ec6-43c2-b5a1-4c9136361591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8b1ecc-8391-45b1-9c5d-d2c1ea095d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:05:55 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Volume 57d9cb51-d3cc-4fba-a686-c682208cf118: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-57d9cb51-d3cc-4fba-a686-c682208cf118', 'volume_size': 1, 'snapshot_id': '47477d67-dc4a-4356-bf8e-b8731db6de1e'}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "cinder-quobyte-47477d67-dc4a-4356-bf8e-b8731db6de1e-57d9cb51-d3cc-4fba-a686-c682208cf118" by "_create_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-quobyte-47477d67-dc4a-4356-bf8e-b8731db6de1e-57d9cb51-d3cc-4fba-a686-c682208cf118" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Creating volume 57d9cb51-d3cc-4fba-a686-c682208cf118 from snapshot 47477d67-dc4a-4356-bf8e-b8731db6de1e {{(pid=81241) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "cinder-quobyte-57d9cb51-d3cc-4fba-a686-c682208cf118" by "_copy_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-quobyte-57d9cb51-d3cc-4fba-a686-c682208cf118" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] snapshot: 47477d67-dc4a-4356-bf8e-b8731db6de1e, volume: 57d9cb51-d3cc-4fba-a686-c682208cf118,  {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0a99e2-a737-4257-883f-87fe7b7469b7]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:55 devstack sudo[90057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e
Apr 24 20:05:55 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:56 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e" returned: 0 in 0.562s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65015e83-5c3b-4664-995a-9312ebd61f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:05:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93 {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 20:05:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Creating direct copy from snapshot {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 20:05:56 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[55da7e9a-8777-4f47-80d8-8968cec5858b]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:05:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:56 devstack sudo[90062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93
Apr 24 20:05:56 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:05:56 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root
Apr 24 20:05:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93" returned: 0 in 0.536s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:05:56 devstack cinder-volume[81241]: DEBUG cinder.utils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Path /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118 not found in is_blk_device check {{(pid=81241) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 20:05:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:05:56 devstack sudo[90067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118
Apr 24 20:05:56 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:01 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118" returned: 0 in 4.549s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:01 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4786c5-59a4-4146-9fae-4b40d5516e18]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:01 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93
Apr 24 20:06:01 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:02 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93" returned: 0 in 0.668s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:02 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118 {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 20:06:02 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Converted 1024.00 MB image at 225.05 MB/s
Apr 24 20:06:02 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118 is being set with open permissions: ugo+rw
Apr 24 20:06:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:02 devstack sudo[90086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118
Apr 24 20:06:02 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:02 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118" returned: 0 in 0.433s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-quobyte-57d9cb51-d3cc-4fba-a686-c682208cf118" released by "_copy_volume_from_snapshot" :: held 6.837s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-quobyte-47477d67-dc4a-4356-bf8e-b8731db6de1e-57d9cb51-d3cc-4fba-a686-c682208cf118" released by "_create_volume_from_snapshot" :: held 6.867s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.885s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8b1ecc-8391-45b1-9c5d-d2c1ea095d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d9cb51-d3cc-4fba-a686-c682208cf118', 'volume_size': 1, 'snapshot_id': '47477d67-dc4a-4356-bf8e-b8731db6de1e'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d557dc9-7b6a-47f4-86a5-ca7740a8ba43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:02 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Volume volume-57d9cb51-d3cc-4fba-a686-c682208cf118 (57d9cb51-d3cc-4fba-a686-c682208cf118): created successfully
Apr 24 20:06:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d557dc9-7b6a-47f4-86a5-ca7740a8ba43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:02 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Flow 'volume_create_manager' (2da08356-cc32-4ac7-ae75-d61c5ed9b4b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:02 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-9c00cf1a-fa3f-48fa-9d46-ea2466148b1a tempest-SnapshotDependencyTests-1878803794 None] Created volume successfully.
Apr 24 20:06:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "cinder-47477d67-dc4a-4356-bf8e-b8731db6de1e-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-47477d67-dc4a-4356-bf8e-b8731db6de1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "cinder-quobyte-65015e83-5c3b-4664-995a-9312ebd61f93" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-quobyte-65015e83-5c3b-4664-995a-9312ebd61f93" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "cinder-quobyte-47477d67-dc4a-4356-bf8e-b8731db6de1e" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-quobyte-47477d67-dc4a-4356-bf8e-b8731db6de1e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Deleting offline snapshot 47477d67-dc4a-4356-bf8e-b8731db6de1e of volume 65015e83-5c3b-4664-995a-9312ebd61f93 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:06:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] snapshot_file for this snap is: volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:06:03 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eb2dfc-447c-4ae7-b3b4-1f3033e73fe6]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:03 devstack sudo[90091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e
Apr 24 20:06:03 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:03 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e" returned: 0 in 0.508s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65015e83-5c3b-4664-995a-9312ebd61f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:06:03 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ede26e-3d86-45dc-b30a-979daefa3eef]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:03 devstack sudo[90096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93
Apr 24 20:06:03 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:04 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93" returned: 0 in 0.533s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:04 devstack sudo[90101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e
Apr 24 20:06:04 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:04 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e" returned: 0 in 0.536s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:04 devstack sudo[90106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e
Apr 24 20:06:04 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:05 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93.47477d67-dc4a-4356-bf8e-b8731db6de1e" returned: 0 in 0.452s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-quobyte-47477d67-dc4a-4356-bf8e-b8731db6de1e" released by "_delete_snapshot" :: held 2.134s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-quobyte-65015e83-5c3b-4664-995a-9312ebd61f93" released by "delete_snapshot" :: held 2.158s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:05 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Created reservations ['f5834b75-0854-43df-9ae9-eed4154bbae0', 'e63e91fc-2ee2-4b74-8805-89a6912e3627', 'e8b7fd5a-e646-4f3a-99ed-d823364d579a', 'df76d9b3-ef37-4911-8e62-43c05be15fae'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:06:05 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Delete snapshot completed successfully.
Apr 24 20:06:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-1ed47d4a-702b-468c-98d4-737e9bb7cb94 tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-47477d67-dc4a-4356-bf8e-b8731db6de1e-delete_snapshot" released by "delete_snapshot" :: held 2.284s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "cinder-65015e83-5c3b-4664-995a-9312ebd61f93-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-65015e83-5c3b-4664-995a-9312ebd61f93-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "cinder-quobyte-65015e83-5c3b-4664-995a-9312ebd61f93" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-quobyte-65015e83-5c3b-4664-995a-9312ebd61f93" acquired by "delete_volume" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:06 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[778d7e2a-8792-4c1b-bc88-8b1f5141122c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:06 devstack sudo[90109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93
Apr 24 20:06:06 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:07 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93" returned: 0 in 0.504s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:07 devstack sudo[90114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93
Apr 24 20:06:07 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:07 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-65015e83-5c3b-4664-995a-9312ebd61f93" returned: 0 in 0.456s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-quobyte-65015e83-5c3b-4664-995a-9312ebd61f93" released by "delete_volume" :: held 1.023s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:07 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Created reservations ['42445683-644d-4d9f-8ae1-704d8e0f274b', '755fff46-c04d-4c3f-9da8-0753e4f66f09', '352780d3-3fbe-47b9-8b6a-18e286630edb', '4a24551c-79b6-40e6-bdef-fe1b312baeb6'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:06:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:07 devstack sudo[90117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:06:07 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:08 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.434s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:08 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:06:08 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Deleted volume successfully.
Apr 24 20:06:08 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-5b6924ba-2ef1-444d-9716-336535998b35 tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-65015e83-5c3b-4664-995a-9312ebd61f93-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:08 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "cinder-57d9cb51-d3cc-4fba-a686-c682208cf118-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:08 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-57d9cb51-d3cc-4fba-a686-c682208cf118-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:08 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "cinder-quobyte-57d9cb51-d3cc-4fba-a686-c682208cf118" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:08 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-quobyte-57d9cb51-d3cc-4fba-a686-c682208cf118" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:08 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaf829e-16eb-46e0-9564-479c0be206a5]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:08 devstack sudo[90120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118
Apr 24 20:06:08 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:09 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118" returned: 0 in 0.530s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:09 devstack sudo[90125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118
Apr 24 20:06:09 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:09 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-57d9cb51-d3cc-4fba-a686-c682208cf118" returned: 0 in 0.455s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-quobyte-57d9cb51-d3cc-4fba-a686-c682208cf118" released by "delete_volume" :: held 1.026s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:09 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Created reservations ['1120f239-b1c0-48e3-b3eb-aa67b166c624', '7e195f5a-ec0c-4ace-bed2-0a0e8ce341ca', '3b2eaa77-b0d2-447f-82a2-14d56ce49def', 'cdd03a7d-762b-4679-843b-a0dc3cd38339'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:06:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:09 devstack sudo[90129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:06:09 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:10 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.458s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:10 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:06:10 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Deleted volume successfully.
Apr 24 20:06:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-43187440-932b-4da7-845e-c4facfa6b74f tempest-SnapshotDependencyTests-1878803794 None] Lock "cinder-57d9cb51-d3cc-4fba-a686-c682208cf118-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:19 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=29,cinder:INSERT=10,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:06:20 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:UPDATE=26,cinder:SELECT=19,cinder:DELETE=2,cinder:INSERT=4 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:06:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 20:06:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:24 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:06:24 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:24 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.521s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:24 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Flow 'volume_create_manager' (40f7f8a7-322e-4a1b-ba5e-b4b9cfe7ed51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23536a0e-961e-4c6d-a466-cec1c6dc14ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23536a0e-961e-4c6d-a466-cec1c6dc14ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1070163167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab9c9f0-e0dc-488a-b492-0277716c3e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5bd24b15c3439ba307b1f4b26c0578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:26Z,use_quota=True,user_id='d96e6d74ffd64a9799f396e1db7c78b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35d4c70-46dc-499f-bdcd-fc2f401d5f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35d4c70-46dc-499f-bdcd-fc2f401d5f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde0a670-e440-48d2-8730-0d9fa918b38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde0a670-e440-48d2-8730-0d9fa918b38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab9c9f0-e0dc-488a-b492-0277716c3e19', 'volume_name': 'volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306f6fc5-84e4-4dad-b07d-60ff4b19b4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306f6fc5-84e4-4dad-b07d-60ff4b19b4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0102205-2e24-47f6-823c-f0f0d5f409fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:25 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume 4ab9c9f0-e0dc-488a-b492-0277716c3e19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19', 'volume_size': 1}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1070163167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab9c9f0-e0dc-488a-b492-0277716c3e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5bd24b15c3439ba307b1f4b26c0578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:26Z,use_quota=True,user_id='d96e6d74ffd64a9799f396e1db7c78b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Creating volume 4ab9c9f0-e0dc-488a-b492-0277716c3e19 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:25 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:25 devstack sudo[90189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19 1073741824
Apr 24 20:06:25 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Flow 'volume_create_manager' (c361f413-2248-484e-9424-c97b45e9fbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f381bd4-eb91-4ea7-9bb1-49977e5d88b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f381bd4-eb91-4ea7-9bb1-49977e5d88b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1957830673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1f7fc5-6647-457a-8506-7113921958c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cdc051556f46729ed61fae5a2ce6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:26Z,use_quota=True,user_id='035c3baa04d4441c9de2898272262f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fd00d6-09ed-4db3-a312-710090708ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fd00d6-09ed-4db3-a312-710090708ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98baf776-d763-4a0a-832c-f1b4615238f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98baf776-d763-4a0a-832c-f1b4615238f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1f7fc5-6647-457a-8506-7113921958c0', 'volume_name': 'volume-ae1f7fc5-6647-457a-8506-7113921958c0', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55055ea-2da1-4af8-9aa8-f88f7a58a35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55055ea-2da1-4af8-9aa8-f88f7a58a35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c231317f-2993-4df7-9588-0ee8e9cb3cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:25 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Volume ae1f7fc5-6647-457a-8506-7113921958c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1f7fc5-6647-457a-8506-7113921958c0', 'volume_size': 1}
Apr 24 20:06:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Flow 'volume_create_manager' (cde683cc-af85-48a1-bbf6-4b32ab077933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9fbe30-b031-4c87-ae2e-1c7135d72726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9fbe30-b031-4c87-ae2e-1c7135d72726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1809108515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fbc583-9b09-4e0f-9c0e-de8841fc4138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6562444365c2410d8d2a38031975b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:26Z,use_quota=True,user_id='e30970d5458f4e70a824aff996652220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2b9cfe-004f-444b-8cb0-1ad5aeaf1dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2b9cfe-004f-444b-8cb0-1ad5aeaf1dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ceb3c2-5f40-47bf-a5e4-26a173a2fae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ceb3c2-5f40-47bf-a5e4-26a173a2fae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69fbc583-9b09-4e0f-9c0e-de8841fc4138', 'volume_name': 'volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62fa670-f148-45b7-85ca-1e3eab0feb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62fa670-f148-45b7-85ca-1e3eab0feb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bd47ef-424b-4cb4-8932-1abc4c77dd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume 69fbc583-9b09-4e0f-9c0e-de8841fc4138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138', 'volume_size': 1}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Flow 'volume_create_manager' (eadc114e-30df-4cea-8efc-2045f48e9f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb14346-3ac0-4e96-84ed-f2f15c3fdec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb14346-3ac0-4e96-84ed-f2f15c3fdec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1628355621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6d3519-8b0f-4962-a190-b88fee0784a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829e892e740f4c0e98f5f59bd911fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:26Z,use_quota=True,user_id='92d07e1801124fbc95ce0d893735b40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd59709-3fd7-4aef-96c5-5012a8977501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd59709-3fd7-4aef-96c5-5012a8977501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0985de47-2b74-47df-90d1-2a827c42c0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0985de47-2b74-47df-90d1-2a827c42c0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed6d3519-8b0f-4962-a190-b88fee0784a3', 'volume_name': 'volume-ed6d3519-8b0f-4962-a190-b88fee0784a3', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9dc37b-7018-4c8c-bb05-33bda05f440f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9dc37b-7018-4c8c-bb05-33bda05f440f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf693194-e7bc-4d5f-9dce-650e0cc8127c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Volume ed6d3519-8b0f-4962-a190-b88fee0784a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed6d3519-8b0f-4962-a190-b88fee0784a3', 'volume_size': 1}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Flow 'volume_create_manager' (21d76cdc-29f8-4817-abb7-9c66e4d992e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec1f9fd-ced0-4f00-ac17-7091c63066ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec1f9fd-ced0-4f00-ac17-7091c63066ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1387826333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a529e38-3a5c-412c-a105-8259a081b686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829e892e740f4c0e98f5f59bd911fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:27Z,use_quota=True,user_id='92d07e1801124fbc95ce0d893735b40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406bbbcd-0e6c-402c-9973-d8a45b7483fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406bbbcd-0e6c-402c-9973-d8a45b7483fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935c383c-a683-49b1-8c88-9bcbbaf0dfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935c383c-a683-49b1-8c88-9bcbbaf0dfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a529e38-3a5c-412c-a105-8259a081b686', 'volume_name': 'volume-3a529e38-3a5c-412c-a105-8259a081b686', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c088d21a-fd89-4e72-bdf2-d9f8f25b58c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c088d21a-fd89-4e72-bdf2-d9f8f25b58c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff83b55-860d-4af0-a57d-333b4c6187bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Volume 3a529e38-3a5c-412c-a105-8259a081b686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a529e38-3a5c-412c-a105-8259a081b686', 'volume_size': 1}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:26 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19 1073741824" returned: 0 in 0.870s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:26 devstack sudo[90194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19
Apr 24 20:06:26 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Flow 'volume_create_manager' (a3881e67-48b9-400b-956e-83a4c55bd0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4471790-1be9-4e2b-b294-ea23cf83e4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4471790-1be9-4e2b-b294-ea23cf83e4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1111500335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c7483d-27e8-4207-ae15-df2ed4667a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829e892e740f4c0e98f5f59bd911fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:27Z,use_quota=True,user_id='92d07e1801124fbc95ce0d893735b40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:26 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f0b52c-2d19-4346-b9c2-0b03db5e51d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f0b52c-2d19-4346-b9c2-0b03db5e51d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91358b58-80c3-47f6-9ab1-80aa2dabf9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91358b58-80c3-47f6-9ab1-80aa2dabf9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1c7483d-27e8-4207-ae15-df2ed4667a59', 'volume_name': 'volume-c1c7483d-27e8-4207-ae15-df2ed4667a59', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b067b3-085f-43aa-8135-19c5560c42c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b067b3-085f-43aa-8135-19c5560c42c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3c1cfe-a1cc-4538-bd2c-9d8718a45158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Volume c1c7483d-27e8-4207-ae15-df2ed4667a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1c7483d-27e8-4207-ae15-df2ed4667a59', 'volume_size': 1}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Flow 'volume_create_manager' (bb3398f8-f9d8-47fd-be8e-91076289a24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabdf505-e93c-4ca2-8fb4-73854c2e82ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabdf505-e93c-4ca2-8fb4-73854c2e82ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-907915457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8a4e97-33bf-45ee-911f-d0ea1a1efe96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829e892e740f4c0e98f5f59bd911fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:27Z,use_quota=True,user_id='92d07e1801124fbc95ce0d893735b40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5d3735-8cb9-4606-bd42-de484f50d253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5d3735-8cb9-4606-bd42-de484f50d253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbdfae3d-7a21-4a4d-8d50-1d591c6cb575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbdfae3d-7a21-4a4d-8d50-1d591c6cb575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e8a4e97-33bf-45ee-911f-d0ea1a1efe96', 'volume_name': 'volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91167aff-82f6-43b1-b54c-ddf9a3d986b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91167aff-82f6-43b1-b54c-ddf9a3d986b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1982ef0-913c-40f7-91e6-bb89af6762f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Volume 5e8a4e97-33bf-45ee-911f-d0ea1a1efe96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96', 'volume_size': 1}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19" returned: 0 in 0.494s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.267s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1957830673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1f7fc5-6647-457a-8506-7113921958c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cdc051556f46729ed61fae5a2ce6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:26Z,use_quota=True,user_id='035c3baa04d4441c9de2898272262f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Creating volume ae1f7fc5-6647-457a-8506-7113921958c0 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:27 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0102205-2e24-47f6-823c-f0f0d5f409fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e25957-4d47-4279-afe0-82a9bfac4491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack sudo[90197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0 1073741824
Apr 24 20:06:27 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:27 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19 (4ab9c9f0-e0dc-488a-b492-0277716c3e19): created successfully
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e25957-4d47-4279-afe0-82a9bfac4491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Flow 'volume_create_manager' (40f7f8a7-322e-4a1b-ba5e-b4b9cfe7ed51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:27 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c004e913-7eec-4866-a091-b202f5a3f9b3 tempest-CreateVolumesFromSnapshotTest-201793910 None] Created volume successfully.
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Flow 'volume_create_manager' (cfcbe119-bcf0-47a2-a4cd-da0217052354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6955a886-a7b4-41f2-9f27-3424cc7a94a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6955a886-a7b4-41f2-9f27-3424cc7a94a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2057156906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed06a38-5c85-475f-a897-d759995f57f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829e892e740f4c0e98f5f59bd911fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:27Z,use_quota=True,user_id='92d07e1801124fbc95ce0d893735b40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (833f28ee-6d6a-49f9-93a0-c632bbfd30bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (833f28ee-6d6a-49f9-93a0-c632bbfd30bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6818ba49-2fd6-440e-b079-516d3c2cd8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6818ba49-2fd6-440e-b079-516d3c2cd8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed06a38-5c85-475f-a897-d759995f57f5', 'volume_name': 'volume-1ed06a38-5c85-475f-a897-d759995f57f5', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17905ca-1523-444e-9aa0-936585cf3884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17905ca-1523-444e-9aa0-936585cf3884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6095ff5-cd96-4f4f-ac67-3b13f15ca30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:27 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Volume 1ed06a38-5c85-475f-a897-d759995f57f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed06a38-5c85-475f-a897-d759995f57f5', 'volume_size': 1}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:27 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0 1073741824" returned: 0 in 0.658s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:27 devstack sudo[90202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0
Apr 24 20:06:27 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:28 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0" returned: 0 in 0.476s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.213s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1809108515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fbc583-9b09-4e0f-9c0e-de8841fc4138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6562444365c2410d8d2a38031975b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:26Z,use_quota=True,user_id='e30970d5458f4e70a824aff996652220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Creating volume 69fbc583-9b09-4e0f-9c0e-de8841fc4138 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:28 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c231317f-2993-4df7-9588-0ee8e9cb3cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1f7fc5-6647-457a-8506-7113921958c0', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737414a2-0e75-4351-ba9a-f052855362b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:28 devstack sudo[90205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138 1073741824
Apr 24 20:06:28 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:28 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Volume volume-ae1f7fc5-6647-457a-8506-7113921958c0 (ae1f7fc5-6647-457a-8506-7113921958c0): created successfully
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737414a2-0e75-4351-ba9a-f052855362b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:28 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Flow 'volume_create_manager' (c361f413-2248-484e-9424-c97b45e9fbe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:28 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d777e8f1-85db-4cc2-bcef-8a295e7fe452 tempest-VolumeDependencyTests-196650729 None] Created volume successfully.
Apr 24 20:06:29 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138 1073741824" returned: 0 in 0.591s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:29 devstack sudo[90210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138
Apr 24 20:06:29 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:29 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138" returned: 0 in 0.512s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.183s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1628355621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6d3519-8b0f-4962-a190-b88fee0784a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829e892e740f4c0e98f5f59bd911fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:26Z,use_quota=True,user_id='92d07e1801124fbc95ce0d893735b40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Creating volume ed6d3519-8b0f-4962-a190-b88fee0784a3 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:29 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ed6d3519-8b0f-4962-a190-b88fee0784a3 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:29 devstack sudo[90214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ed6d3519-8b0f-4962-a190-b88fee0784a3 1073741824
Apr 24 20:06:29 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bd47ef-424b-4cb4-8932-1abc4c77dd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5577b71-ba76-4305-b046-b8a3eb71044c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:29 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138 (69fbc583-9b09-4e0f-9c0e-de8841fc4138): created successfully
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5577b71-ba76-4305-b046-b8a3eb71044c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:29 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Flow 'volume_create_manager' (cde683cc-af85-48a1-bbf6-4b32ab077933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:29 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-831b0c9e-d8a1-42e2-b364-a94fc33830de tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Created volume successfully.
Apr 24 20:06:30 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ed6d3519-8b0f-4962-a190-b88fee0784a3 1073741824" returned: 0 in 0.630s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ed6d3519-8b0f-4962-a190-b88fee0784a3 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:30 devstack sudo[90219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ed6d3519-8b0f-4962-a190-b88fee0784a3
Apr 24 20:06:30 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:30 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ed6d3519-8b0f-4962-a190-b88fee0784a3" returned: 0 in 0.474s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.059s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1387826333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a529e38-3a5c-412c-a105-8259a081b686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829e892e740f4c0e98f5f59bd911fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:27Z,use_quota=True,user_id='92d07e1801124fbc95ce0d893735b40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Creating volume 3a529e38-3a5c-412c-a105-8259a081b686 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:30 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3a529e38-3a5c-412c-a105-8259a081b686 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:30 devstack sudo[90222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3a529e38-3a5c-412c-a105-8259a081b686 1073741824
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf693194-e7bc-4d5f-9dce-650e0cc8127c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed6d3519-8b0f-4962-a190-b88fee0784a3', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:30 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e737a5-a22a-436f-8be4-b70a282f5bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:30 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Volume volume-ed6d3519-8b0f-4962-a190-b88fee0784a3 (ed6d3519-8b0f-4962-a190-b88fee0784a3): created successfully
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e737a5-a22a-436f-8be4-b70a282f5bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Flow 'volume_create_manager' (eadc114e-30df-4cea-8efc-2045f48e9f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:30 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-1266f8fe-bd91-4115-b486-b0e973d26370 tempest-CreateVolumesFromImageTest-96129790 None] Created volume successfully.
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Flow 'volume_create_manager' (355a5f11-f2c8-4769-8f1e-47c2181047a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd56373-0bc0-4377-9a11-a725119a46d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd56373-0bc0-4377-9a11-a725119a46d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-142276482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9aaac76-d9b8-4849-ae1f-e5b87fc67aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6562444365c2410d8d2a38031975b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:31Z,use_quota=True,user_id='e30970d5458f4e70a824aff996652220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c89e166-f37b-4ad1-953f-80bb36278d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c89e166-f37b-4ad1-953f-80bb36278d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee4aa26-23f3-49da-8ae9-618fe845c202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:30 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee4aa26-23f3-49da-8ae9-618fe845c202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9aaac76-d9b8-4849-ae1f-e5b87fc67aab', 'volume_name': 'volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02276388-0b52-46d8-98c9-8106d853366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02276388-0b52-46d8-98c9-8106d853366f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0f2099-8e92-4e32-92ef-496bf6fffcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume b9aaac76-d9b8-4849-ae1f-e5b87fc67aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab', 'volume_size': 1}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Flow 'volume_create_manager' (2ca9c4dd-af8d-40f7-824d-2f8c5877bda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9751d37-4b60-49bf-b210-c2bd2eaf9745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9751d37-4b60-49bf-b210-c2bd2eaf9745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-436730452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6562444365c2410d8d2a38031975b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:31Z,use_quota=True,user_id='e30970d5458f4e70a824aff996652220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3041f484-4523-4bb1-a8ca-17481a4d02ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3041f484-4523-4bb1-a8ca-17481a4d02ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7fbc60-7039-485e-8bab-cb3629dc3aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7fbc60-7039-485e-8bab-cb3629dc3aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f4d3e5-ece8-45ad-afe0-25ce61e8b46a', 'volume_name': 'volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5dbed5-d04f-4e89-9a83-c4f867cd18f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5dbed5-d04f-4e89-9a83-c4f867cd18f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e32743-cc24-4b45-92ed-2a377e98aa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a', 'volume_size': 1}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Flow 'volume_create_manager' (8523df77-428e-4925-b0b3-e045ba0a6c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8098050d-f1cb-4a05-b60b-e333e2c295bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8098050d-f1cb-4a05-b60b-e333e2c295bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1283341912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6b8590-d336-4182-8ba0-a30bb04d8480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6562444365c2410d8d2a38031975b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:31Z,use_quota=True,user_id='e30970d5458f4e70a824aff996652220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f99a4d-0759-4019-899b-f080e100fab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f99a4d-0759-4019-899b-f080e100fab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748dc831-7baa-4a40-a7ea-ecaa01db2929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748dc831-7baa-4a40-a7ea-ecaa01db2929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da6b8590-d336-4182-8ba0-a30bb04d8480', 'volume_name': 'volume-da6b8590-d336-4182-8ba0-a30bb04d8480', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61803c58-e57c-4714-8765-34cda8331716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61803c58-e57c-4714-8765-34cda8331716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2e9cd0-86c0-4bf6-8754-720f14c233d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume da6b8590-d336-4182-8ba0-a30bb04d8480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da6b8590-d336-4182-8ba0-a30bb04d8480', 'volume_size': 1}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:31 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3a529e38-3a5c-412c-a105-8259a081b686 1073741824" returned: 0 in 0.771s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3a529e38-3a5c-412c-a105-8259a081b686 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:31 devstack sudo[90227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3a529e38-3a5c-412c-a105-8259a081b686
Apr 24 20:06:31 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Flow 'volume_create_manager' (ab57e162-619d-423f-95fa-0ac211016c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6e49ef-a40f-4587-a444-e4a41274046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6e49ef-a40f-4587-a444-e4a41274046f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-484997035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7695f5c-d356-4cfb-8e76-e68c8892392c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6562444365c2410d8d2a38031975b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:32Z,use_quota=True,user_id='e30970d5458f4e70a824aff996652220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037ccf01-6ee4-4927-8b37-29fc897fe4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037ccf01-6ee4-4927-8b37-29fc897fe4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67292cbe-ecfc-4cd9-8fa1-33342b4ef73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67292cbe-ecfc-4cd9-8fa1-33342b4ef73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7695f5c-d356-4cfb-8e76-e68c8892392c', 'volume_name': 'volume-b7695f5c-d356-4cfb-8e76-e68c8892392c', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36984b9-a000-45e1-906c-178b965d941c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36984b9-a000-45e1-906c-178b965d941c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da2fcee-0f72-4cff-ba98-7ad0c6db85d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:31 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume b7695f5c-d356-4cfb-8e76-e68c8892392c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7695f5c-d356-4cfb-8e76-e68c8892392c', 'volume_size': 1}
Apr 24 20:06:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Flow 'volume_create_manager' (4ae545b8-ff4c-4e93-bd38-91bc12d6c0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c130735-afcd-4c85-8a0a-2ec183bd2081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c130735-afcd-4c85-8a0a-2ec183bd2081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331216158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234231bb-6a00-49c7-8f05-f8667ebe6d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6562444365c2410d8d2a38031975b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:32Z,use_quota=True,user_id='e30970d5458f4e70a824aff996652220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd767dbd-1fac-4111-ba18-5138d4e054b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd767dbd-1fac-4111-ba18-5138d4e054b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:32 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb013a0-27b9-43c1-86e4-590728091b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb013a0-27b9-43c1-86e4-590728091b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234231bb-6a00-49c7-8f05-f8667ebe6d72', 'volume_name': 'volume-234231bb-6a00-49c7-8f05-f8667ebe6d72', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e56694-ed1c-4147-b3a9-ee14d6b3c52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e56694-ed1c-4147-b3a9-ee14d6b3c52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4167d25-2d0a-48ad-bb3a-4de4b6abe579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:32 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume 234231bb-6a00-49c7-8f05-f8667ebe6d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234231bb-6a00-49c7-8f05-f8667ebe6d72', 'volume_size': 1}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3a529e38-3a5c-412c-a105-8259a081b686" returned: 0 in 0.510s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.044s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1111500335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c7483d-27e8-4207-ae15-df2ed4667a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829e892e740f4c0e98f5f59bd911fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:27Z,use_quota=True,user_id='92d07e1801124fbc95ce0d893735b40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Creating volume c1c7483d-27e8-4207-ae15-df2ed4667a59 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:32 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c1c7483d-27e8-4207-ae15-df2ed4667a59 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff83b55-860d-4af0-a57d-333b4c6187bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a529e38-3a5c-412c-a105-8259a081b686', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edf956c-87ee-4e18-a350-84399437547e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:32 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c1c7483d-27e8-4207-ae15-df2ed4667a59 1073741824
Apr 24 20:06:32 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:32 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Volume volume-3a529e38-3a5c-412c-a105-8259a081b686 (3a529e38-3a5c-412c-a105-8259a081b686): created successfully
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edf956c-87ee-4e18-a350-84399437547e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Flow 'volume_create_manager' (21d76cdc-29f8-4817-abb7-9c66e4d992e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:32 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-81673a72-7980-46af-87e8-37064449fd01 tempest-CreateVolumesFromImageTest-96129790 None] Created volume successfully.
Apr 24 20:06:32 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c1c7483d-27e8-4207-ae15-df2ed4667a59 1073741824" returned: 0 in 0.649s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c1c7483d-27e8-4207-ae15-df2ed4667a59 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:32 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c1c7483d-27e8-4207-ae15-df2ed4667a59
Apr 24 20:06:32 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:33 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c1c7483d-27e8-4207-ae15-df2ed4667a59" returned: 0 in 0.444s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.969s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-907915457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8a4e97-33bf-45ee-911f-d0ea1a1efe96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829e892e740f4c0e98f5f59bd911fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:27Z,use_quota=True,user_id='92d07e1801124fbc95ce0d893735b40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Creating volume 5e8a4e97-33bf-45ee-911f-d0ea1a1efe96 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:33 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3c1cfe-a1cc-4538-bd2c-9d8718a45158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c7483d-27e8-4207-ae15-df2ed4667a59', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b420f0-370c-40e0-94ef-e6bad4b35608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:33 devstack sudo[90238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96 1073741824
Apr 24 20:06:33 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:33 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Volume volume-c1c7483d-27e8-4207-ae15-df2ed4667a59 (c1c7483d-27e8-4207-ae15-df2ed4667a59): created successfully
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b420f0-370c-40e0-94ef-e6bad4b35608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Flow 'volume_create_manager' (a3881e67-48b9-400b-956e-83a4c55bd0d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:33 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c4e66931-867e-45bb-96a7-e2403d2ff182 tempest-CreateVolumesFromImageTest-96129790 None] Created volume successfully.
Apr 24 20:06:33 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96 1073741824" returned: 0 in 0.636s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:33 devstack sudo[90243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96
Apr 24 20:06:33 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:34 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96" returned: 0 in 0.497s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.889s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2057156906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed06a38-5c85-475f-a897-d759995f57f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829e892e740f4c0e98f5f59bd911fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:27Z,use_quota=True,user_id='92d07e1801124fbc95ce0d893735b40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Creating volume 1ed06a38-5c85-475f-a897-d759995f57f5 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:34 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1ed06a38-5c85-475f-a897-d759995f57f5 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1982ef0-913c-40f7-91e6-bb89af6762f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22dd0295-1bfa-46fb-94f9-9e1aacfb604d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:34 devstack sudo[90246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1ed06a38-5c85-475f-a897-d759995f57f5 1073741824
Apr 24 20:06:34 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:34 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Volume volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96 (5e8a4e97-33bf-45ee-911f-d0ea1a1efe96): created successfully
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22dd0295-1bfa-46fb-94f9-9e1aacfb604d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Flow 'volume_create_manager' (bb3398f8-f9d8-47fd-be8e-91076289a24b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:34 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-9d91be01-b53a-4473-94e3-cad23180732e tempest-CreateVolumesFromImageTest-96129790 None] Created volume successfully.
Apr 24 20:06:35 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1ed06a38-5c85-475f-a897-d759995f57f5 1073741824" returned: 0 in 0.640s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1ed06a38-5c85-475f-a897-d759995f57f5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:35 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1ed06a38-5c85-475f-a897-d759995f57f5
Apr 24 20:06:35 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:35 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1ed06a38-5c85-475f-a897-d759995f57f5" returned: 0 in 0.465s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.473s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6095ff5-cd96-4f4f-ac67-3b13f15ca30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed06a38-5c85-475f-a897-d759995f57f5', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d51ef3-ddcf-49ba-a8bd-fa53fa681a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Creating offline snapshot a8df2dde-a26a-4428-bb28-4da49ddc94d2 of volume 4ab9c9f0-e0dc-488a-b492-0277716c3e19 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:06:35 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Volume volume-1ed06a38-5c85-475f-a897-d759995f57f5 (1ed06a38-5c85-475f-a897-d759995f57f5): created successfully
Apr 24 20:06:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d51ef3-ddcf-49ba-a8bd-fa53fa681a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:35 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Flow 'volume_create_manager' (cfcbe119-bcf0-47a2-a4cd-da0217052354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:35 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fff5ca-279e-4812-9aeb-792639c63790]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:35 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-31cb5531-a418-4e61-a25e-e73d23c8fa16 tempest-CreateVolumesFromImageTest-96129790 None] Created volume successfully.
Apr 24 20:06:35 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19
Apr 24 20:06:35 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:36 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19" returned: 0 in 0.561s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:36 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2 1G
Apr 24 20:06:36 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "cinder-1ed06a38-5c85-475f-a897-d759995f57f5-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-1ed06a38-5c85-475f-a897-d759995f57f5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "cinder-quobyte-1ed06a38-5c85-475f-a897-d759995f57f5" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-quobyte-1ed06a38-5c85-475f-a897-d759995f57f5" acquired by "delete_volume" :: waited 0.021s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:36 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[322ca669-9e6f-404e-83cc-49a900a0f774]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1ed06a38-5c85-475f-a897-d759995f57f5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:36 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1ed06a38-5c85-475f-a897-d759995f57f5
Apr 24 20:06:36 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:36 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2 1G" returned: 0 in 0.648s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:36 devstack sudo[90269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2
Apr 24 20:06:36 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:36 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1ed06a38-5c85-475f-a897-d759995f57f5" returned: 0 in 0.559s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1ed06a38-5c85-475f-a897-d759995f57f5 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:36 devstack sudo[90271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1ed06a38-5c85-475f-a897-d759995f57f5
Apr 24 20:06:36 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:37 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2" returned: 0 in 0.515s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:37 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2 is being set with open permissions: ugo+rw
Apr 24 20:06:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:37 devstack sudo[90277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2
Apr 24 20:06:37 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:37 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-1ed06a38-5c85-475f-a897-d759995f57f5" returned: 0 in 0.488s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:37 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-quobyte-1ed06a38-5c85-475f-a897-d759995f57f5" released by "delete_volume" :: held 1.091s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:37 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Created reservations ['cb108881-edb4-4d19-9803-1d97c4789220', 'b750daa5-56a5-433b-8970-9812c4b9e7d4', 'efb30df6-e0bb-416d-9361-98d6eb84d1ef', 'e82914c5-fa2a-4ef4-99dd-68fdbe9374c0'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:06:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:37 devstack sudo[90279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:06:37 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:37 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2" returned: 0 in 0.491s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:37 devstack sudo[90283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.info
Apr 24 20:06:37 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:37 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.449s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:06:38 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Deleted volume successfully.
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d8fe0f7a-3527-4427-bd51-149008f57e38 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-1ed06a38-5c85-475f-a897-d759995f57f5-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:38 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.info" returned: 0 in 0.478s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:38 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.info is being set with open permissions: ugo+rw
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:38 devstack sudo[90286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.info
Apr 24 20:06:38 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "cinder-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "cinder-quobyte-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-quobyte-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96" acquired by "delete_volume" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[485bfc13-95ee-499a-a20e-eee2e7653a39]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:38 devstack sudo[90288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96
Apr 24 20:06:38 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:38 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.info" returned: 0 in 0.489s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.337s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.390s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] Creating offline snapshot f8580ea9-d8a6-402f-b8be-78c120be21f2 of volume ae1f7fc5-6647-457a-8506-7113921958c0 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:06:38 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-57e9f9e3-736b-449a-8f1e-40ce094daac7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Create snapshot completed successfully
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a683e871-1d12-4da6-ad7b-12f305648206]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:39 devstack sudo[90291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0
Apr 24 20:06:39 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:39 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96" returned: 0 in 0.568s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:39 devstack sudo[90296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96
Apr 24 20:06:39 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:39 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0" returned: 0 in 0.535s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:39 devstack sudo[90302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2 1G
Apr 24 20:06:39 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:39 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96" returned: 0 in 0.475s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-quobyte-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96" released by "delete_volume" :: held 1.086s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Created reservations ['e034ab78-6224-4293-9393-f592aead19a2', '0a6de82c-acec-4d42-935a-27d5f38a72fd', '57a84354-fa89-487d-9971-4432e40013a5', '767bd81f-5b0f-4c14-a7fb-efecd4d211c6'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:39 devstack sudo[90305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:06:39 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Flow 'volume_create_manager' (78ba50e3-91d7-41e1-912e-1f729624d773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f3c9e1-c51e-4969-bea7-955ad8549bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f3c9e1-c51e-4969-bea7-955ad8549bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-630558003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096e5eac-c827-4a27-b00e-b21928fa5219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5bd24b15c3439ba307b1f4b26c0578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:40Z,use_quota=True,user_id='d96e6d74ffd64a9799f396e1db7c78b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63e0a36-08ac-470b-8b31-0d97cec6dd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63e0a36-08ac-470b-8b31-0d97cec6dd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47e3946-c909-470f-9174-8884c24ddef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47e3946-c909-470f-9174-8884c24ddef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '096e5eac-c827-4a27-b00e-b21928fa5219', 'volume_name': 'volume-096e5eac-c827-4a27-b00e-b21928fa5219', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (323bcbd5-296a-404d-bb8d-115ee6937267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (323bcbd5-296a-404d-bb8d-115ee6937267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3a4cd5-77ac-4862-bc4b-0c1c97170df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:39 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume 096e5eac-c827-4a27-b00e-b21928fa5219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-096e5eac-c827-4a27-b00e-b21928fa5219', 'volume_size': 1}
Apr 24 20:06:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:40 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2 1G" returned: 0 in 0.717s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1f7fc5-6647-457a-8506-7113921958c0 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:40 devstack sudo[90310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1f7fc5-6647-457a-8506-7113921958c0 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2
Apr 24 20:06:40 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Flow 'volume_create_manager' (e7b71bb6-0985-4c77-99a0-4f6448e64f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddf9180-62c6-4c84-920d-60ca20fe42b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddf9180-62c6-4c84-920d-60ca20fe42b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1673345570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5bd24b15c3439ba307b1f4b26c0578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:40Z,use_quota=True,user_id='d96e6d74ffd64a9799f396e1db7c78b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36930b4-290b-4555-b355-efa42b0d8889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36930b4-290b-4555-b355-efa42b0d8889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270e6d00-c40a-4245-b79f-bc0c417fbc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270e6d00-c40a-4245-b79f-bc0c417fbc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8', 'volume_name': 'volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492d4bea-53da-4ab8-86c1-61bb9032589c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492d4bea-53da-4ab8-86c1-61bb9032589c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bb0898-9493-41b6-b7f1-78f1c72962d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:40 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8', 'volume_size': 1}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:40 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.606s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:06:40 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Deleted volume successfully.
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-95229611-59dd-4159-ae85-7bc030703e15 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-5e8a4e97-33bf-45ee-911f-d0ea1a1efe96-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Flow 'volume_create_manager' (88bdd3fc-7249-4337-9ae9-e77030a03bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd2e5a8-3417-4312-915b-174867bc6021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd2e5a8-3417-4312-915b-174867bc6021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1105954319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8b4233-64be-495e-84e2-d9cacf15c123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5bd24b15c3439ba307b1f4b26c0578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:40Z,use_quota=True,user_id='d96e6d74ffd64a9799f396e1db7c78b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab57957-2095-49a1-8536-c9715e6fc186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab57957-2095-49a1-8536-c9715e6fc186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0052a2-d0a0-4e00-a070-66f77a4d5b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0052a2-d0a0-4e00-a070-66f77a4d5b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c8b4233-64be-495e-84e2-d9cacf15c123', 'volume_name': 'volume-5c8b4233-64be-495e-84e2-d9cacf15c123', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7bb13f-ae2b-45af-812a-014e1d271b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7bb13f-ae2b-45af-812a-014e1d271b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30fc69a1-05b7-4b56-9a15-fd4aeeeebdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:40 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume 5c8b4233-64be-495e-84e2-d9cacf15c123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c8b4233-64be-495e-84e2-d9cacf15c123', 'volume_size': 1}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "cinder-c1c7483d-27e8-4207-ae15-df2ed4667a59-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-c1c7483d-27e8-4207-ae15-df2ed4667a59-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:40 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1f7fc5-6647-457a-8506-7113921958c0 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2" returned: 0 in 0.558s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:40 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2 is being set with open permissions: ugo+rw
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:40 devstack sudo[90316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2
Apr 24 20:06:40 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "cinder-quobyte-c1c7483d-27e8-4207-ae15-df2ed4667a59" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-quobyte-c1c7483d-27e8-4207-ae15-df2ed4667a59" acquired by "delete_volume" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7288bf03-55a5-4950-8972-9b3daf2214a1]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c1c7483d-27e8-4207-ae15-df2ed4667a59 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Flow 'volume_create_manager' (821167ad-2c66-432b-91ca-66e6ed99a243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:40 devstack sudo[90318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c1c7483d-27e8-4207-ae15-df2ed4667a59
Apr 24 20:06:40 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:40 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166bf95d-016e-4ad6-8a29-18f0405ea9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166bf95d-016e-4ad6-8a29-18f0405ea9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1217683820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308949c2-c1e5-4a79-8925-f0f73a96bf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5bd24b15c3439ba307b1f4b26c0578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:41Z,use_quota=True,user_id='d96e6d74ffd64a9799f396e1db7c78b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e7a995-2a64-4534-993a-869ebd19cf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e7a995-2a64-4534-993a-869ebd19cf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb786b40-04af-449f-b0f9-2db90aa824a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb786b40-04af-449f-b0f9-2db90aa824a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '308949c2-c1e5-4a79-8925-f0f73a96bf7c', 'volume_name': 'volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0bca2da-ce56-4776-aec1-7eb2b63dc202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0bca2da-ce56-4776-aec1-7eb2b63dc202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7931eb-9eaa-4c63-8716-7ab71e710558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:41 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume 308949c2-c1e5-4a79-8925-f0f73a96bf7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c', 'volume_size': 1}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:41 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Flow 'volume_create_manager' (252cd2e3-78c1-45e7-b045-e4761fdb656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0ebc3d-eaaf-4119-a1ec-cb0d6d7cd017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2" returned: 0 in 0.581s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0ebc3d-eaaf-4119-a1ec-cb0d6d7cd017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2005411892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d47a8a-a84c-48b5-b0d2-5d39071d9e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5bd24b15c3439ba307b1f4b26c0578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:41Z,use_quota=True,user_id='d96e6d74ffd64a9799f396e1db7c78b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5843e249-7280-472c-8c61-2261d61ae511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5843e249-7280-472c-8c61-2261d61ae511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9804390b-481c-4671-933e-af5b8952fc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9804390b-481c-4671-933e-af5b8952fc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60d47a8a-a84c-48b5-b0d2-5d39071d9e3f', 'volume_name': 'volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (affd4046-b88f-48ab-aafe-8d831078d7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (affd4046-b88f-48ab-aafe-8d831078d7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12c529e-785a-4eea-9581-6aaa81f95bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:41 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume 60d47a8a-a84c-48b5-b0d2-5d39071d9e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f', 'volume_size': 1}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:41 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.info
Apr 24 20:06:41 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:41 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c1c7483d-27e8-4207-ae15-df2ed4667a59" returned: 0 in 0.622s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c1c7483d-27e8-4207-ae15-df2ed4667a59 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:41 devstack sudo[90358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c1c7483d-27e8-4207-ae15-df2ed4667a59
Apr 24 20:06:41 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:41 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.info" returned: 0 in 0.473s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:41 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.info is being set with open permissions: ugo+rw
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:41 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.info
Apr 24 20:06:41 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:41 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:41 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-c1c7483d-27e8-4207-ae15-df2ed4667a59" returned: 0 in 0.480s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-quobyte-c1c7483d-27e8-4207-ae15-df2ed4667a59" released by "delete_volume" :: held 1.150s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Created reservations ['d99a4a8c-ed05-4d2d-9433-02cf8bf6df8a', 'fa09359b-5623-4fba-940e-d2763340323e', '420289ae-c5f4-43d1-bbc7-a2c4aa25d5a6', '41d17935-fe73-4623-a7c8-303f96c94121'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:42 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:06:42 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:42 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.info" returned: 0 in 0.495s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.507s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.387s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-142276482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9aaac76-d9b8-4849-ae1f-e5b87fc67aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6562444365c2410d8d2a38031975b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:31Z,use_quota=True,user_id='e30970d5458f4e70a824aff996652220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Creating volume b9aaac76-d9b8-4849-ae1f-e5b87fc67aab {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:42 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:42 devstack sudo[90369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab 1073741824
Apr 24 20:06:42 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:42 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-4844d2e5-f0f9-42d4-85f3-48bb5c033f45 tempest-VolumeDependencyTests-196650729 None] Create snapshot completed successfully
Apr 24 20:06:42 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.461s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:06:42 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Deleted volume successfully.
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c836f87f-993d-4056-979e-ec6648a6a2c7 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-c1c7483d-27e8-4207-ae15-df2ed4667a59-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:42 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "cinder-3a529e38-3a5c-412c-a105-8259a081b686-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-3a529e38-3a5c-412c-a105-8259a081b686-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "cinder-quobyte-3a529e38-3a5c-412c-a105-8259a081b686" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-quobyte-3a529e38-3a5c-412c-a105-8259a081b686" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0199cba5-e2de-49b5-a526-a2bc70b24292]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3a529e38-3a5c-412c-a105-8259a081b686 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:43 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab 1073741824" returned: 0 in 0.699s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:43 devstack sudo[90375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3a529e38-3a5c-412c-a105-8259a081b686
Apr 24 20:06:43 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:43 devstack sudo[90376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab
Apr 24 20:06:43 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Flow 'volume_create_manager' (a2fd68da-ca4f-40ae-a5b2-3f06f8e27e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f51dd4-bc38-4482-a9fc-cd5b5256e250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f51dd4-bc38-4482-a9fc-cd5b5256e250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-343746394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b566472-f25a-444f-90a2-983a0d29665f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cdc051556f46729ed61fae5a2ce6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f8580ea9-d8a6-402f-b8be-78c120be21f2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:43Z,use_quota=True,user_id='035c3baa04d4441c9de2898272262f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267c2619-c568-4287-a025-837a53269685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267c2619-c568-4287-a025-837a53269685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f9dc0e-6459-48af-9243-bd78c8ca6942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f9dc0e-6459-48af-9243-bd78c8ca6942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0b566472-f25a-444f-90a2-983a0d29665f', 'volume_name': 'volume-0b566472-f25a-444f-90a2-983a0d29665f', 'volume_size': 1, 'snapshot_id': 'f8580ea9-d8a6-402f-b8be-78c120be21f2'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea55421d-50e0-45ec-8dc7-593565aa6705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea55421d-50e0-45ec-8dc7-593565aa6705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd91582-2f92-4ac9-bcb0-f79e37fdcfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:43 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Volume 0b566472-f25a-444f-90a2-983a0d29665f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0b566472-f25a-444f-90a2-983a0d29665f', 'volume_size': 1, 'snapshot_id': 'f8580ea9-d8a6-402f-b8be-78c120be21f2'}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:43 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab" returned: 0 in 0.535s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.414s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:43 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-436730452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6562444365c2410d8d2a38031975b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:31Z,use_quota=True,user_id='e30970d5458f4e70a824aff996652220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Creating volume d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:43 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3a529e38-3a5c-412c-a105-8259a081b686" returned: 0 in 0.641s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3a529e38-3a5c-412c-a105-8259a081b686 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:43 devstack sudo[90383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a 1073741824
Apr 24 20:06:43 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0f2099-8e92-4e32-92ef-496bf6fffcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:43 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3a529e38-3a5c-412c-a105-8259a081b686
Apr 24 20:06:43 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3018b6-8182-44bf-97c7-71efd8741fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:43 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab (b9aaac76-d9b8-4849-ae1f-e5b87fc67aab): created successfully
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3018b6-8182-44bf-97c7-71efd8741fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:43 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Flow 'volume_create_manager' (355a5f11-f2c8-4769-8f1e-47c2181047a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:43 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-51e7f43a-2158-4fa5-a49b-fd859609c48c tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Created volume successfully.
Apr 24 20:06:44 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3a529e38-3a5c-412c-a105-8259a081b686" returned: 0 in 0.507s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-quobyte-3a529e38-3a5c-412c-a105-8259a081b686" released by "delete_volume" :: held 1.190s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Created reservations ['8f86d211-f429-4d67-8589-99af57f9c28e', '510b9e93-4060-405f-ac33-e11c48918fa9', 'aa3858af-bc51-46d9-b785-34b7e532deea', '3a4dde31-97f7-4afa-84ae-ccb91885206d'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:44 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a 1073741824" returned: 0 in 0.656s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:44 devstack sudo[90391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:06:44 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:44 devstack sudo[90393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a
Apr 24 20:06:44 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:44 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.457s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:06:44 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Deleted volume successfully.
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-24e55299-9da1-48c7-a56b-c09d1d5ad380 tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-3a529e38-3a5c-412c-a105-8259a081b686-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:44 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a" returned: 0 in 0.475s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.385s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1283341912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6b8590-d336-4182-8ba0-a30bb04d8480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6562444365c2410d8d2a38031975b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:31Z,use_quota=True,user_id='e30970d5458f4e70a824aff996652220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Creating volume da6b8590-d336-4182-8ba0-a30bb04d8480 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:44 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-da6b8590-d336-4182-8ba0-a30bb04d8480 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:44 devstack sudo[90397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-da6b8590-d336-4182-8ba0-a30bb04d8480 1073741824
Apr 24 20:06:44 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e32743-cc24-4b45-92ed-2a377e98aa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621fbe2b-78c8-47a0-919b-21fc810ccc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:44 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a (d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a): created successfully
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621fbe2b-78c8-47a0-919b-21fc810ccc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:44 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Flow 'volume_create_manager' (2ca9c4dd-af8d-40f7-824d-2f8c5877bda3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:44 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-07205a2a-b2c9-46b4-a177-22fdc09851d8 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Created volume successfully.
Apr 24 20:06:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "cinder-ed6d3519-8b0f-4962-a190-b88fee0784a3-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-ed6d3519-8b0f-4962-a190-b88fee0784a3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "cinder-quobyte-ed6d3519-8b0f-4962-a190-b88fee0784a3" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:45 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-quobyte-ed6d3519-8b0f-4962-a190-b88fee0784a3" acquired by "delete_volume" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:45 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[471e4d52-8ccb-4410-a9b4-c8c262a4dd41]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ed6d3519-8b0f-4962-a190-b88fee0784a3 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:45 devstack sudo[90403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ed6d3519-8b0f-4962-a190-b88fee0784a3
Apr 24 20:06:45 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:45 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-da6b8590-d336-4182-8ba0-a30bb04d8480 1073741824" returned: 0 in 0.662s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-da6b8590-d336-4182-8ba0-a30bb04d8480 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:45 devstack sudo[90405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-da6b8590-d336-4182-8ba0-a30bb04d8480
Apr 24 20:06:45 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:45 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ed6d3519-8b0f-4962-a190-b88fee0784a3" returned: 0 in 0.570s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ed6d3519-8b0f-4962-a190-b88fee0784a3 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:45 devstack sudo[90410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ed6d3519-8b0f-4962-a190-b88fee0784a3
Apr 24 20:06:45 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:46 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-da6b8590-d336-4182-8ba0-a30bb04d8480" returned: 0 in 0.458s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.214s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-484997035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7695f5c-d356-4cfb-8e76-e68c8892392c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6562444365c2410d8d2a38031975b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:32Z,use_quota=True,user_id='e30970d5458f4e70a824aff996652220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Creating volume b7695f5c-d356-4cfb-8e76-e68c8892392c {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:46 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7695f5c-d356-4cfb-8e76-e68c8892392c 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2e9cd0-86c0-4bf6-8754-720f14c233d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da6b8590-d336-4182-8ba0-a30bb04d8480', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:46 devstack sudo[90413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7695f5c-d356-4cfb-8e76-e68c8892392c 1073741824
Apr 24 20:06:46 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4aa4711-8107-4e98-83c9-8446f1d7a438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:46 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume volume-da6b8590-d336-4182-8ba0-a30bb04d8480 (da6b8590-d336-4182-8ba0-a30bb04d8480): created successfully
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4aa4711-8107-4e98-83c9-8446f1d7a438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Flow 'volume_create_manager' (8523df77-428e-4925-b0b3-e045ba0a6c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:46 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-081fc0ae-1698-4a4d-92c7-a35d4cbb8d8f tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Created volume successfully.
Apr 24 20:06:46 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ed6d3519-8b0f-4962-a190-b88fee0784a3" returned: 0 in 0.521s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-quobyte-ed6d3519-8b0f-4962-a190-b88fee0784a3" released by "delete_volume" :: held 1.135s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Created reservations ['46b37991-4746-4264-b649-c34092be8910', '138dc272-6e65-4bee-972a-dcd3e23af664', '582a8654-d7d3-495c-a8d6-982f31883e67', '6872ea95-dd9e-42c1-b6e9-8ea892d2c840'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:46 devstack sudo[90419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:06:46 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:46 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7695f5c-d356-4cfb-8e76-e68c8892392c 1073741824" returned: 0 in 0.713s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7695f5c-d356-4cfb-8e76-e68c8892392c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:46 devstack sudo[90421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7695f5c-d356-4cfb-8e76-e68c8892392c
Apr 24 20:06:46 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:47 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.504s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:06:47 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Deleted volume successfully.
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-56ceeed5-e0c0-4bc4-83e4-8558086210ae tempest-CreateVolumesFromImageTest-96129790 None] Lock "cinder-ed6d3519-8b0f-4962-a190-b88fee0784a3-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:47 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7695f5c-d356-4cfb-8e76-e68c8892392c" returned: 0 in 0.467s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.202s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331216158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234231bb-6a00-49c7-8f05-f8667ebe6d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6562444365c2410d8d2a38031975b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:32Z,use_quota=True,user_id='e30970d5458f4e70a824aff996652220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Creating volume 234231bb-6a00-49c7-8f05-f8667ebe6d72 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:47 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-234231bb-6a00-49c7-8f05-f8667ebe6d72 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da2fcee-0f72-4cff-ba98-7ad0c6db85d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7695f5c-d356-4cfb-8e76-e68c8892392c', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:47 devstack sudo[90425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-234231bb-6a00-49c7-8f05-f8667ebe6d72 1073741824
Apr 24 20:06:47 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc510de-7ce9-45f1-abdd-80d6deb2046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:47 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume volume-b7695f5c-d356-4cfb-8e76-e68c8892392c (b7695f5c-d356-4cfb-8e76-e68c8892392c): created successfully
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc510de-7ce9-45f1-abdd-80d6deb2046b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Flow 'volume_create_manager' (ab57e162-619d-423f-95fa-0ac211016c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:47 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-3da31163-91ea-493c-b35c-e0df185e2f4e tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Created volume successfully.
Apr 24 20:06:47 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-234231bb-6a00-49c7-8f05-f8667ebe6d72 1073741824" returned: 0 in 0.656s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-234231bb-6a00-49c7-8f05-f8667ebe6d72 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:47 devstack sudo[90430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-234231bb-6a00-49c7-8f05-f8667ebe6d72
Apr 24 20:06:47 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:48 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-234231bb-6a00-49c7-8f05-f8667ebe6d72" returned: 0 in 0.566s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.547s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-630558003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096e5eac-c827-4a27-b00e-b21928fa5219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5bd24b15c3439ba307b1f4b26c0578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:40Z,use_quota=True,user_id='d96e6d74ffd64a9799f396e1db7c78b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Creating volume 096e5eac-c827-4a27-b00e-b21928fa5219 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:48 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-096e5eac-c827-4a27-b00e-b21928fa5219 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:48 devstack sudo[90434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-096e5eac-c827-4a27-b00e-b21928fa5219 1073741824
Apr 24 20:06:48 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4167d25-2d0a-48ad-bb3a-4de4b6abe579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234231bb-6a00-49c7-8f05-f8667ebe6d72', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613e914b-139c-44fb-a923-390293b543a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:48 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Volume volume-234231bb-6a00-49c7-8f05-f8667ebe6d72 (234231bb-6a00-49c7-8f05-f8667ebe6d72): created successfully
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613e914b-139c-44fb-a923-390293b543a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:48 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Flow 'volume_create_manager' (4ae545b8-ff4c-4e93-bd38-91bc12d6c0a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:48 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-87eb4495-3ff0-47b3-be82-7f196d008a0b tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Created volume successfully.
Apr 24 20:06:49 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-096e5eac-c827-4a27-b00e-b21928fa5219 1073741824" returned: 0 in 0.746s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-096e5eac-c827-4a27-b00e-b21928fa5219 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:49 devstack sudo[90439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-096e5eac-c827-4a27-b00e-b21928fa5219
Apr 24 20:06:49 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "cinder-234231bb-6a00-49c7-8f05-f8667ebe6d72-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-234231bb-6a00-49c7-8f05-f8667ebe6d72-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "cinder-quobyte-234231bb-6a00-49c7-8f05-f8667ebe6d72" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-quobyte-234231bb-6a00-49c7-8f05-f8667ebe6d72" acquired by "delete_volume" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[727ac477-582d-419f-a73d-e3d275e20565]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-234231bb-6a00-49c7-8f05-f8667ebe6d72 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:49 devstack sudo[90442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-234231bb-6a00-49c7-8f05-f8667ebe6d72
Apr 24 20:06:49 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:49 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-096e5eac-c827-4a27-b00e-b21928fa5219" returned: 0 in 0.580s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.565s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1673345570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5bd24b15c3439ba307b1f4b26c0578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:40Z,use_quota=True,user_id='d96e6d74ffd64a9799f396e1db7c78b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Creating volume fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:49 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3a4cd5-77ac-4862-bc4b-0c1c97170df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-096e5eac-c827-4a27-b00e-b21928fa5219', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7dc0b3-32bc-42c8-96bc-a3efd0b34960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:49 devstack sudo[90445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8 1073741824
Apr 24 20:06:49 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume volume-096e5eac-c827-4a27-b00e-b21928fa5219 (096e5eac-c827-4a27-b00e-b21928fa5219): created successfully
Apr 24 20:06:49 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7dc0b3-32bc-42c8-96bc-a3efd0b34960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:49 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Flow 'volume_create_manager' (78ba50e3-91d7-41e1-912e-1f729624d773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:50 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d95295a5-310e-4ab1-b0b7-692ebe559aa7 tempest-CreateVolumesFromSnapshotTest-201793910 None] Created volume successfully.
Apr 24 20:06:50 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-234231bb-6a00-49c7-8f05-f8667ebe6d72" returned: 0 in 0.695s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-234231bb-6a00-49c7-8f05-f8667ebe6d72 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:50 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-234231bb-6a00-49c7-8f05-f8667ebe6d72
Apr 24 20:06:50 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:50 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8 1073741824" returned: 0 in 0.740s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:50 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-234231bb-6a00-49c7-8f05-f8667ebe6d72" returned: 0 in 0.531s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:50 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8
Apr 24 20:06:50 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-quobyte-234231bb-6a00-49c7-8f05-f8667ebe6d72" released by "delete_volume" :: held 1.273s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:50 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:50 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Created reservations ['5225d3a1-361a-4b6c-b8e9-1462cf6e1909', '297c88f0-4cba-48fa-90d6-0c2d5d8ed431', 'b4ef0995-814f-42ea-bb54-2d76d0b39520', '6bf55220-df71-40d4-aa44-f8dd1a573765'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:06:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:50 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:50 devstack sudo[90458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:06:50 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:51 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8" returned: 0 in 0.551s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.655s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1105954319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8b4233-64be-495e-84e2-d9cacf15c123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5bd24b15c3439ba307b1f4b26c0578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:40Z,use_quota=True,user_id='d96e6d74ffd64a9799f396e1db7c78b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Creating volume 5c8b4233-64be-495e-84e2-d9cacf15c123 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:51 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5c8b4233-64be-495e-84e2-d9cacf15c123 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bb0898-9493-41b6-b7f1-78f1c72962d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65905bd-f8e4-4084-ac22-35fb44bb06d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:51 devstack sudo[90461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5c8b4233-64be-495e-84e2-d9cacf15c123 1073741824
Apr 24 20:06:51 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8 (fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8): created successfully
Apr 24 20:06:51 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65905bd-f8e4-4084-ac22-35fb44bb06d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Flow 'volume_create_manager' (e7b71bb6-0985-4c77-99a0-4f6448e64f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:51 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-299f4555-4dca-4222-9be1-ed9747331493 tempest-CreateVolumesFromSnapshotTest-201793910 None] Created volume successfully.
Apr 24 20:06:51 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.634s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:06:51 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Deleted volume successfully.
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-cc447e92-c0bc-42fc-ba2a-04d898c06044 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-234231bb-6a00-49c7-8f05-f8667ebe6d72-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "cinder-b7695f5c-d356-4cfb-8e76-e68c8892392c-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-b7695f5c-d356-4cfb-8e76-e68c8892392c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "cinder-quobyte-b7695f5c-d356-4cfb-8e76-e68c8892392c" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-quobyte-b7695f5c-d356-4cfb-8e76-e68c8892392c" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aa697f-2972-4109-acc3-34033d49ad01]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7695f5c-d356-4cfb-8e76-e68c8892392c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:51 devstack sudo[90464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7695f5c-d356-4cfb-8e76-e68c8892392c
Apr 24 20:06:51 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:52 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5c8b4233-64be-495e-84e2-d9cacf15c123 1073741824" returned: 0 in 0.799s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5c8b4233-64be-495e-84e2-d9cacf15c123 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:52 devstack sudo[90469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5c8b4233-64be-495e-84e2-d9cacf15c123
Apr 24 20:06:52 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:52 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7695f5c-d356-4cfb-8e76-e68c8892392c" returned: 0 in 0.743s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7695f5c-d356-4cfb-8e76-e68c8892392c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:52 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7695f5c-d356-4cfb-8e76-e68c8892392c
Apr 24 20:06:52 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:52 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5c8b4233-64be-495e-84e2-d9cacf15c123" returned: 0 in 0.491s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.564s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1217683820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308949c2-c1e5-4a79-8925-f0f73a96bf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5bd24b15c3439ba307b1f4b26c0578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:41Z,use_quota=True,user_id='d96e6d74ffd64a9799f396e1db7c78b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Creating volume 308949c2-c1e5-4a79-8925-f0f73a96bf7c {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:52 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:52 devstack sudo[90477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c 1073741824
Apr 24 20:06:52 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30fc69a1-05b7-4b56-9a15-fd4aeeeebdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c8b4233-64be-495e-84e2-d9cacf15c123', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d264b7c-c972-435a-8437-e89401532105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:52 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume volume-5c8b4233-64be-495e-84e2-d9cacf15c123 (5c8b4233-64be-495e-84e2-d9cacf15c123): created successfully
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d264b7c-c972-435a-8437-e89401532105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:52 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Flow 'volume_create_manager' (88bdd3fc-7249-4337-9ae9-e77030a03bc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:52 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-1b269160-880e-4de5-a97b-4eb339ed2697 tempest-CreateVolumesFromSnapshotTest-201793910 None] Created volume successfully.
Apr 24 20:06:53 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b7695f5c-d356-4cfb-8e76-e68c8892392c" returned: 0 in 0.536s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-quobyte-b7695f5c-d356-4cfb-8e76-e68c8892392c" released by "delete_volume" :: held 1.331s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Created reservations ['16745d71-c498-48a2-a12e-d9e194a82250', '151d2fbb-8089-4bc1-bead-811cadd5bb25', '6e0dac1c-8695-4f89-a1af-390868fa5984', 'dee50cbb-4235-4ac1-8ff7-4fae01e421c9'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:53 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:06:53 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:53 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c 1073741824" returned: 0 in 0.838s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:53 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c
Apr 24 20:06:53 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:53 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.527s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:06:53 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Deleted volume successfully.
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-aa1391f9-b8c2-4d0d-b797-0d76d04a768d tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-b7695f5c-d356-4cfb-8e76-e68c8892392c-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "cinder-da6b8590-d336-4182-8ba0-a30bb04d8480-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-da6b8590-d336-4182-8ba0-a30bb04d8480-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "cinder-quobyte-da6b8590-d336-4182-8ba0-a30bb04d8480" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-quobyte-da6b8590-d336-4182-8ba0-a30bb04d8480" acquired by "delete_volume" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8db678-4b26-4c26-9ffe-f035066f1cbc]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-da6b8590-d336-4182-8ba0-a30bb04d8480 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:54 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c" returned: 0 in 0.527s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.657s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2005411892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d47a8a-a84c-48b5-b0d2-5d39071d9e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5bd24b15c3439ba307b1f4b26c0578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:06:41Z,use_quota=True,user_id='d96e6d74ffd64a9799f396e1db7c78b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Creating volume 60d47a8a-a84c-48b5-b0d2-5d39071d9e3f {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:54 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:54 devstack sudo[90489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-da6b8590-d336-4182-8ba0-a30bb04d8480
Apr 24 20:06:54 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7931eb-9eaa-4c63-8716-7ab71e710558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1dcf053-3ca4-44bb-96e1-baf3bee0b14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:54 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c (308949c2-c1e5-4a79-8925-f0f73a96bf7c): created successfully
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1dcf053-3ca4-44bb-96e1-baf3bee0b14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Flow 'volume_create_manager' (821167ad-2c66-432b-91ca-66e6ed99a243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:54 devstack sudo[90490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f 1073741824
Apr 24 20:06:54 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:54 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8505d386-12b4-45e8-af0a-0371b73bc503 tempest-CreateVolumesFromSnapshotTest-201793910 None] Created volume successfully.
Apr 24 20:06:54 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-da6b8590-d336-4182-8ba0-a30bb04d8480" returned: 0 in 0.721s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-da6b8590-d336-4182-8ba0-a30bb04d8480 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:54 devstack sudo[90499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-da6b8590-d336-4182-8ba0-a30bb04d8480
Apr 24 20:06:54 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:54 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f 1073741824" returned: 0 in 0.814s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:54 devstack sudo[90501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f
Apr 24 20:06:54 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:55 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-da6b8590-d336-4182-8ba0-a30bb04d8480" returned: 0 in 0.603s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-quobyte-da6b8590-d336-4182-8ba0-a30bb04d8480" released by "delete_volume" :: held 1.365s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Created reservations ['16aa5525-cbcd-4032-b157-fdcb0a7a0d18', 'd60e682b-1de9-402f-ba14-0e01eda8cd87', '9842228f-ef0c-4570-a7e9-9e99ec4919bc', '4a61118e-9190-4a04-89a3-4155d25ea2d3'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:55 devstack sudo[90505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:06:55 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:55 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f" returned: 0 in 0.658s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 12.020s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-quobyte-f8580ea9-d8a6-402f-b8be-78c120be21f2-0b566472-f25a-444f-90a2-983a0d29665f" by "_create_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-f8580ea9-d8a6-402f-b8be-78c120be21f2-0b566472-f25a-444f-90a2-983a0d29665f" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Creating volume 0b566472-f25a-444f-90a2-983a0d29665f from snapshot f8580ea9-d8a6-402f-b8be-78c120be21f2 {{(pid=81241) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-quobyte-0b566472-f25a-444f-90a2-983a0d29665f" by "_copy_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12c529e-785a-4eea-9581-6aaa81f95bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908f11d4-cd88-47fd-bf3c-0ec7b2acfe55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:06:55 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Volume volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f (60d47a8a-a84c-48b5-b0d2-5d39071d9e3f): created successfully
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908f11d4-cd88-47fd-bf3c-0ec7b2acfe55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Flow 'volume_create_manager' (252cd2e3-78c1-45e7-b045-e4761fdb656a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:06:55 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-eaa75c37-02ad-443e-a893-d42815bf4154 tempest-CreateVolumesFromSnapshotTest-201793910 None] Created volume successfully.
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-0b566472-f25a-444f-90a2-983a0d29665f" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] snapshot: f8580ea9-d8a6-402f-b8be-78c120be21f2, volume: 0b566472-f25a-444f-90a2-983a0d29665f,  {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec3f320-cc2d-43b3-98ea-cfe43edd73ce]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:55 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:55 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2
Apr 24 20:06:55 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:56 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.574s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:06:56 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Deleted volume successfully.
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-37e5bc11-693d-4a40-ac7a-3b2de85b0c21 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-da6b8590-d336-4182-8ba0-a30bb04d8480-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "cinder-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "cinder-quobyte-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-quobyte-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a" acquired by "delete_volume" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9891d28-f12e-4519-8b0c-1dfbac550b87]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:56 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:56 devstack sudo[90513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2" returned: 0 in 0.734s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:56 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1f7fc5-6647-457a-8506-7113921958c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0 {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Creating direct copy from snapshot {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ee5a7f-8ff2-48a4-aab1-85fc2abc65de]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:56 devstack sudo[90515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0
Apr 24 20:06:56 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-quobyte-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f" acquired by "delete_volume" :: waited 0.024s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b9bd31-89f7-4bef-a8dc-a6ba65f7dd26]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:56 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:56 devstack sudo[90517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f
Apr 24 20:06:56 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:57 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a" returned: 0 in 0.887s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:57 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0" returned: 0 in 0.823s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:57 devstack cinder-volume[81241]: DEBUG cinder.utils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Path /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f not found in is_blk_device check {{(pid=81241) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 20:06:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:57 devstack sudo[90525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a
Apr 24 20:06:57 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:57 devstack sudo[90526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f
Apr 24 20:06:57 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:57 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f" returned: 0 in 0.950s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:57 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:57 devstack sudo[90532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f
Apr 24 20:06:57 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:58 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a" returned: 0 in 0.888s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-quobyte-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a" released by "delete_volume" :: held 1.857s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Created reservations ['bfb278a2-c0ec-4281-a1b9-a411946acc6f', 'fc48b257-63c8-4294-ae5f-7def84b3ee24', 'ce79868e-47c0-4bcc-90ea-46b58a401fae', 'a4d6d4a9-f083-4e48-bef3-e6391abab093'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "cinder-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:58 devstack sudo[90547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:06:58 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:58 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f" returned: 0 in 1.052s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "cinder-quobyte-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f" released by "delete_volume" :: held 2.087s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-quobyte-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab" acquired by "delete_volume" :: waited 0.079s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd55bec9-5ad4-49d5-84da-689dafdf4d12]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:06:58 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:59 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Created reservations ['e4b100e0-3eca-44cf-8983-5987f890cecd', 'e86cc65e-c732-4c09-ac17-005b4e9a0049', 'dc6c4356-792e-43d7-a3cb-03162c5d2c9a', '772d3fb7-34e7-43f3-96b4-d51f6dac511e'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:06:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:06:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:06:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:06:59 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:06:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:06:59 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:06:59 devstack sudo[90549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab
Apr 24 20:06:59 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:06:59 devstack sudo[90550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:06:59 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:00 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.512s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:00 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:00 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Deleted volume successfully.
Apr 24 20:07:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d4c75378-5d33-4df2-a0b4-3f08406585e2 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-d6f4d3e5-ece8-45ad-afe0-25ce61e8b46a-delete_volume" released by "delete_volume" :: held 4.012s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-308949c2-c1e5-4a79-8925-f0f73a96bf7c-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-308949c2-c1e5-4a79-8925-f0f73a96bf7c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-quobyte-308949c2-c1e5-4a79-8925-f0f73a96bf7c" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:00 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-308949c2-c1e5-4a79-8925-f0f73a96bf7c" acquired by "delete_volume" :: waited 0.035s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:00 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8474b824-2ecd-4b4b-81a0-1b29f4be170c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:00 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:00 devstack sudo[90555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c
Apr 24 20:07:00 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:01 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab" returned: 0 in 2.456s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:01 devstack sudo[90561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab
Apr 24 20:07:01 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:01 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:01 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 2.406s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:01 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:01 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Deleted volume successfully.
Apr 24 20:07:01 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-c2003016-cb66-4931-82cf-5ccb51925d31 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-60d47a8a-a84c-48b5-b0d2-5d39071d9e3f-delete_volume" released by "delete_volume" :: held 4.892s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:02 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c" returned: 0 in 1.950s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:02 devstack sudo[90566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c
Apr 24 20:07:02 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:02 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:02 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab" returned: 0 in 1.394s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:02 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-quobyte-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab" released by "delete_volume" :: held 3.947s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:02 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Created reservations ['6380c5ed-5912-4d03-9143-c6b37be21a01', 'ee87d8fd-3f83-4916-8e2c-4b9b9bc6d7a5', 'f1bcc7cb-3c40-497d-bcfd-6ac866c36c1b', '1032bc0b-5ad2-43a9-9238-2a71c845cc61'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:03 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:03 devstack sudo[90569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:03 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "cinder-69fbc583-9b09-4e0f-9c0e-de8841fc4138-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-69fbc583-9b09-4e0f-9c0e-de8841fc4138-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "cinder-quobyte-69fbc583-9b09-4e0f-9c0e-de8841fc4138" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:03 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-quobyte-69fbc583-9b09-4e0f-9c0e-de8841fc4138" acquired by "delete_volume" :: waited 0.034s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:03 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c5eb27-f0de-4d23-b49a-31e30b044b56]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:03 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:04 devstack sudo[90571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138
Apr 24 20:07:04 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:04 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-308949c2-c1e5-4a79-8925-f0f73a96bf7c" returned: 0 in 1.620s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-308949c2-c1e5-4a79-8925-f0f73a96bf7c" released by "delete_volume" :: held 3.757s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Created reservations ['64f9011b-8c7c-4cb6-8a23-d9704d9e833d', 'eeaa730c-1479-423a-9217-885b7f6c0d9d', '1bce53d3-f69a-44b5-9c8c-34ce8d385ab7', 'bc54c1c2-224e-4d2d-8b95-f941433d64a9'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:04 devstack sudo[90574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:04 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:04 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f" returned: 0 in 7.348s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9327fa68-2286-4e35-b23b-4125801ce724]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:04 devstack sudo[90577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0
Apr 24 20:07:04 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:04 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.797s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:04 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Deleted volume successfully.
Apr 24 20:07:04 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138" returned: 0 in 1.092s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:04 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a6c7f28e-2872-43a7-905a-99f42a3f5831 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-b9aaac76-d9b8-4849-ae1f-e5b87fc67aab-delete_volume" released by "delete_volume" :: held 6.210s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:04 devstack sudo[90582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138
Apr 24 20:07:04 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:05 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.671s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:05 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Deleted volume successfully.
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-61e1a03e-6f44-4fdb-9015-0b1d1bc297ac tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-308949c2-c1e5-4a79-8925-f0f73a96bf7c-delete_volume" released by "delete_volume" :: held 4.878s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-5c8b4233-64be-495e-84e2-d9cacf15c123-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-5c8b4233-64be-495e-84e2-d9cacf15c123-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-quobyte-5c8b4233-64be-495e-84e2-d9cacf15c123" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-5c8b4233-64be-495e-84e2-d9cacf15c123" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[249950e7-878f-4f55-845d-775bff72d055]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5c8b4233-64be-495e-84e2-d9cacf15c123 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:05 devstack sudo[90587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5c8b4233-64be-495e-84e2-d9cacf15c123
Apr 24 20:07:05 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:05 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-69fbc583-9b09-4e0f-9c0e-de8841fc4138" returned: 0 in 0.667s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-quobyte-69fbc583-9b09-4e0f-9c0e-de8841fc4138" released by "delete_volume" :: held 1.831s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Created reservations ['297d3ff4-4993-41b1-bcf0-0b33422a8ba6', '4bfa0dac-7b70-4b01-8fb2-2d33eb3f4c8c', 'c462e1c7-da12-4d48-81a8-b029c430b2f9', '3ef134bc-8423-438f-8bb9-b965f2502c69'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:05 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0" returned: 0 in 0.985s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0, size 1024.00 MB, duration 7.35 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 20:07:05 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Converted 1024.00 MB image at 139.31 MB/s
Apr 24 20:07:05 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f is being set with open permissions: ugo+rw
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:05 devstack sudo[90591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f
Apr 24 20:07:05 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:05 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:05 devstack sudo[90593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:05 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:06 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5c8b4233-64be-495e-84e2-d9cacf15c123" returned: 0 in 0.660s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5c8b4233-64be-495e-84e2-d9cacf15c123 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:06 devstack sudo[90598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5c8b4233-64be-495e-84e2-d9cacf15c123
Apr 24 20:07:06 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:06 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.704s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:06 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Deleted volume successfully.
Apr 24 20:07:06 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f" returned: 0 in 0.778s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-0b566472-f25a-444f-90a2-983a0d29665f" released by "_copy_volume_from_snapshot" :: held 10.784s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12454568-a21a-461e-8c27-bad4487b9b17 tempest-CreateVolumesFromSourceVolumeTest-1061195504 None] Lock "cinder-69fbc583-9b09-4e0f-9c0e-de8841fc4138-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-f8580ea9-d8a6-402f-b8be-78c120be21f2-0b566472-f25a-444f-90a2-983a0d29665f" released by "_create_volume_from_snapshot" :: held 10.865s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.883s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd91582-2f92-4ac9-bcb0-f79e37fdcfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b566472-f25a-444f-90a2-983a0d29665f', 'volume_size': 1, 'snapshot_id': 'f8580ea9-d8a6-402f-b8be-78c120be21f2'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a303081f-687d-46a4-b780-fe52a5c1a4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:06 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Volume volume-0b566472-f25a-444f-90a2-983a0d29665f (0b566472-f25a-444f-90a2-983a0d29665f): created successfully
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a303081f-687d-46a4-b780-fe52a5c1a4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Flow 'volume_create_manager' (a2fd68da-ca4f-40ae-a5b2-3f06f8e27e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:07:06 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-9a4f25f1-9b39-4b0e-a88d-89bc37684080 tempest-VolumeDependencyTests-196650729 None] Created volume successfully.
Apr 24 20:07:06 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-5c8b4233-64be-495e-84e2-d9cacf15c123" returned: 0 in 0.692s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-5c8b4233-64be-495e-84e2-d9cacf15c123" released by "delete_volume" :: held 1.400s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Created reservations ['266eafb3-caba-4e40-ad8d-dc2e9b716c17', 'ec6e9710-3fff-4acd-86c3-11c1e2e3720a', '670e12f1-56c9-4820-b2ee-f9f3fdf912db', '0d88d9af-6416-4ede-bdc3-73de07cac3ea'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:06 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:06 devstack sudo[90603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:06 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:07 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.607s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:07 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Deleted volume successfully.
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bf78b5ec-ddf0-494c-b8f4-96b4fe0d5f44 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-5c8b4233-64be-495e-84e2-d9cacf15c123-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-quobyte-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8" acquired by "delete_volume" :: waited 0.033s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efa35e2-4ea6-4348-a24a-5ea06f8f92ba]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-f8580ea9-d8a6-402f-b8be-78c120be21f2-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-f8580ea9-d8a6-402f-b8be-78c120be21f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-quobyte-ae1f7fc5-6647-457a-8506-7113921958c0" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-ae1f7fc5-6647-457a-8506-7113921958c0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-quobyte-f8580ea9-d8a6-402f-b8be-78c120be21f2" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-f8580ea9-d8a6-402f-b8be-78c120be21f2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Deleting offline snapshot f8580ea9-d8a6-402f-b8be-78c120be21f2 of volume ae1f7fc5-6647-457a-8506-7113921958c0 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] snapshot_file for this snap is: volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[99000554-e26e-4bd0-95a5-cf35aae0441d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:07 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:07 devstack sudo[90606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8
Apr 24 20:07:07 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:07 devstack sudo[90607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2
Apr 24 20:07:07 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:08 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8" returned: 0 in 0.841s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:08 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2" returned: 0 in 0.730s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:08 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1f7fc5-6647-457a-8506-7113921958c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:07:08 devstack sudo[90616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8
Apr 24 20:07:08 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:08 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b2fecb-c8e6-4f3a-876d-81e033605eca]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:08 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:08 devstack sudo[90618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0
Apr 24 20:07:08 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:09 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8" returned: 0 in 0.654s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8" released by "delete_volume" :: held 1.560s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Created reservations ['71a677fd-680e-4496-904f-758f01c505bc', '1433bc55-ec8f-4e11-bf8d-b51928f3220b', 'b9deba40-eefd-4a0a-9e22-5209c23e84f2', 'ac8f895a-2f7a-4fb0-93a2-1c6ce9b3e11f'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:07:09 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Flow 'volume_create_manager' (c3d5c8e3-7d46-4907-8573-76485983591e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13082efe-75f3-4fa8-898e-9d7320a5c07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0" returned: 0 in 0.796s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:09 devstack sudo[90625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2
Apr 24 20:07:09 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13082efe-75f3-4fa8-898e-9d7320a5c07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf30a89-2048-4a01-94aa-4b2ae112a377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4c6d80111044f4a582b231c6fa7ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:07:09Z,use_quota=True,user_id='9a889ea940da40a9950e8a586c1eb03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:09 devstack sudo[90627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:09 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcbb71f-e7c0-4d65-a0a9-f15e96b72b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcbb71f-e7c0-4d65-a0a9-f15e96b72b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f755d2-29fe-4366-bd49-87f50ed6fd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f755d2-29fe-4366-bd49-87f50ed6fd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf30a89-2048-4a01-94aa-4b2ae112a377', 'volume_name': 'volume-fcf30a89-2048-4a01-94aa-4b2ae112a377', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481b4022-091f-45d0-84b6-264415e3c117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481b4022-091f-45d0-84b6-264415e3c117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf63e96-4169-43b9-b4e3-8e199b5cfb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:09 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Volume fcf30a89-2048-4a01-94aa-4b2ae112a377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf30a89-2048-4a01-94aa-4b2ae112a377', 'volume_size': 1}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf30a89-2048-4a01-94aa-4b2ae112a377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4c6d80111044f4a582b231c6fa7ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:07:09Z,use_quota=True,user_id='9a889ea940da40a9950e8a586c1eb03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Creating volume fcf30a89-2048-4a01-94aa-4b2ae112a377 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:07:09 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:07:09 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fcf30a89-2048-4a01-94aa-4b2ae112a377 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:09 devstack sudo[90629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fcf30a89-2048-4a01-94aa-4b2ae112a377 1073741824
Apr 24 20:07:09 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-096e5eac-c827-4a27-b00e-b21928fa5219-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-096e5eac-c827-4a27-b00e-b21928fa5219-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-quobyte-096e5eac-c827-4a27-b00e-b21928fa5219" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-096e5eac-c827-4a27-b00e-b21928fa5219" acquired by "delete_volume" :: waited 0.026s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ab97bc-bb5e-4a49-b9b1-7026090f6bd4]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-096e5eac-c827-4a27-b00e-b21928fa5219 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:10 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.803s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:10 devstack sudo[90635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-096e5eac-c827-4a27-b00e-b21928fa5219
Apr 24 20:07:10 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:10 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Deleted volume successfully.
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-b9f16303-4feb-4ef2-953c-e64fefa3f52d tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-fc01b24e-f009-4a0e-8d2c-ce2595b3f5a8-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:10 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2" returned: 0 in 0.949s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:10 devstack sudo[90640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2
Apr 24 20:07:10 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:10 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fcf30a89-2048-4a01-94aa-4b2ae112a377 1073741824" returned: 0 in 1.152s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fcf30a89-2048-4a01-94aa-4b2ae112a377 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:10 devstack sudo[90645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fcf30a89-2048-4a01-94aa-4b2ae112a377
Apr 24 20:07:10 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:10 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-096e5eac-c827-4a27-b00e-b21928fa5219" returned: 0 in 0.829s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:10 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-096e5eac-c827-4a27-b00e-b21928fa5219 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:11 devstack sudo[90647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-096e5eac-c827-4a27-b00e-b21928fa5219
Apr 24 20:07:11 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:11 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0.f8580ea9-d8a6-402f-b8be-78c120be21f2" returned: 0 in 0.844s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-f8580ea9-d8a6-402f-b8be-78c120be21f2" released by "_delete_snapshot" :: held 3.447s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-ae1f7fc5-6647-457a-8506-7113921958c0" released by "delete_snapshot" :: held 3.475s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Created reservations ['e7b74952-df4d-46fa-94f5-5292ecef69f9', '67275652-bc32-400d-9c14-45eebe444c12', 'ec80cb4e-3498-45ee-8528-1abfb2794ed8', '5c0e44f3-087c-4628-b876-01a5faa82d7a'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:11 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Delete snapshot completed successfully.
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-ab0f7b4d-002b-4a71-883f-6566546edd27 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-f8580ea9-d8a6-402f-b8be-78c120be21f2-delete_snapshot" released by "delete_snapshot" :: held 3.657s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:11 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fcf30a89-2048-4a01-94aa-4b2ae112a377" returned: 0 in 0.761s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf63e96-4169-43b9-b4e3-8e199b5cfb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf30a89-2048-4a01-94aa-4b2ae112a377', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cad70c-032d-4517-ba65-02407df18a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:11 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Volume volume-fcf30a89-2048-4a01-94aa-4b2ae112a377 (fcf30a89-2048-4a01-94aa-4b2ae112a377): created successfully
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cad70c-032d-4517-ba65-02407df18a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Flow 'volume_create_manager' (c3d5c8e3-7d46-4907-8573-76485983591e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:07:11 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a8e6db44-f477-40a1-ac91-887678687f57 tempest-CinderUnicodeTest-1382036803 None] Created volume successfully.
Apr 24 20:07:11 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-096e5eac-c827-4a27-b00e-b21928fa5219" returned: 0 in 0.726s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-096e5eac-c827-4a27-b00e-b21928fa5219" released by "delete_volume" :: held 1.607s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Created reservations ['51eeff15-3a5d-44f4-a921-252219bde664', 'ec507b82-5663-49f7-a770-38c86b5ed9fa', '5898ea30-9d82-4da8-902e-cec9baf059c2', 'b72863db-4e9f-466a-88e7-603fe7517a50'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:11 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:11 devstack sudo[90652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:11 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-ae1f7fc5-6647-457a-8506-7113921958c0-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Lock "cinder-ae1f7fc5-6647-457a-8506-7113921958c0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-quobyte-ae1f7fc5-6647-457a-8506-7113921958c0" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-ae1f7fc5-6647-457a-8506-7113921958c0" acquired by "delete_volume" :: waited 0.027s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[852d80a9-a948-47c8-a6c3-3f0ed55dfc5c]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-a8df2dde-a26a-4428-bb28-4da49ddc94d2-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-a8df2dde-a26a-4428-bb28-4da49ddc94d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-quobyte-4ab9c9f0-e0dc-488a-b492-0277716c3e19" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-4ab9c9f0-e0dc-488a-b492-0277716c3e19" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-quobyte-a8df2dde-a26a-4428-bb28-4da49ddc94d2" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-a8df2dde-a26a-4428-bb28-4da49ddc94d2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Deleting offline snapshot a8df2dde-a26a-4428-bb28-4da49ddc94d2 of volume 4ab9c9f0-e0dc-488a-b492-0277716c3e19 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:07:12 devstack sudo[90654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0
Apr 24 20:07:12 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] snapshot_file for this snap is: volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca341cad-230a-4a0b-bfdb-a6ee93aa8687]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:12 devstack sudo[90656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2
Apr 24 20:07:12 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:12 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.690s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:12 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Deleted volume successfully.
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-779d85c9-aec0-4e53-9315-af31d6492306 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-096e5eac-c827-4a27-b00e-b21928fa5219-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:12 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0" returned: 0 in 0.751s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:12 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:13 devstack sudo[90662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0
Apr 24 20:07:13 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:07:13 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Flow 'volume_create_manager' (23cd117b-1e86-4b96-af9b-dcdbd89be0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef10b02-6cf0-46c7-874f-1c77d75789f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2" returned: 0 in 0.865s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef10b02-6cf0-46c7-874f-1c77d75789f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:07:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1469457042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301cc3b9-0593-40db-8e16-60ffa1078666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4c6d80111044f4a582b231c6fa7ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:07:13Z,use_quota=True,user_id='9a889ea940da40a9950e8a586c1eb03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4d0e3d-986a-4460-b047-e5939723170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4d0e3d-986a-4460-b047-e5939723170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6291107-567d-4be7-a6c7-229b968d0e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6291107-567d-4be7-a6c7-229b968d0e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301cc3b9-0593-40db-8e16-60ffa1078666', 'volume_name': 'volume-301cc3b9-0593-40db-8e16-60ffa1078666', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2d2098-76d2-46b0-afe2-4635a4552309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2d2098-76d2-46b0-afe2-4635a4552309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9ac5ec-4915-4f54-8634-a4ed007f4ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:13 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Volume 301cc3b9-0593-40db-8e16-60ffa1078666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301cc3b9-0593-40db-8e16-60ffa1078666', 'volume_size': 1}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:07:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1469457042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301cc3b9-0593-40db-8e16-60ffa1078666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4c6d80111044f4a582b231c6fa7ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:07:13Z,use_quota=True,user_id='9a889ea940da40a9950e8a586c1eb03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Creating volume 301cc3b9-0593-40db-8e16-60ffa1078666 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:07:13 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd0c024-392d-473e-b8b1-40c9f3ef731b]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:13 devstack sudo[90667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666 1073741824
Apr 24 20:07:13 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:13 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19
Apr 24 20:07:13 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:13 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-ae1f7fc5-6647-457a-8506-7113921958c0" returned: 0 in 0.635s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-ae1f7fc5-6647-457a-8506-7113921958c0" released by "delete_volume" :: held 1.466s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Created reservations ['b84aeb59-890a-477f-98de-edfa05637426', '6b14bf1b-f12e-4fa2-87a7-f0d352508741', 'd050f7d7-4c42-40c7-b3a4-a84be24cbedc', '304b481d-04b0-493b-9cf7-f5bbdf2cd63a'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:13 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:13 devstack sudo[90672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:13 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:14 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19" returned: 0 in 0.767s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:14 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666 1073741824" returned: 0 in 0.813s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:14 devstack sudo[90680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2
Apr 24 20:07:14 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:14 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:14 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.575s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:14 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:14 devstack sudo[90683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666
Apr 24 20:07:14 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:14 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Deleted volume successfully.
Apr 24 20:07:14 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-f257945b-34ea-4ae3-a506-292ca83052ab tempest-VolumeDependencyTests-196650729 None] Lock "cinder-ae1f7fc5-6647-457a-8506-7113921958c0-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:14 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:07:14 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Flow 'volume_create_manager' (185e8f7e-5b34-4afc-83cd-8af54a73216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3632cabd-66ff-4c14-85c1-278cc2bc07d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666" returned: 0 in 0.727s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:15 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9ac5ec-4915-4f54-8634-a4ed007f4ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301cc3b9-0593-40db-8e16-60ffa1078666', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9216e30b-6c36-4bc9-ab6c-ab3e76cc49b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2" returned: 0 in 0.871s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3632cabd-66ff-4c14-85c1-278cc2bc07d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-108685412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08781ab7-f47b-479b-a287-e74dbbb029cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cdc051556f46729ed61fae5a2ce6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:07:15Z,use_quota=True,user_id='035c3baa04d4441c9de2898272262f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:15 devstack sudo[90689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2
Apr 24 20:07:15 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ecec5c-3bdc-4da6-b065-d566f6549f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ecec5c-3bdc-4da6-b065-d566f6549f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845ccd3e-9207-4e2d-b615-c2b617b012c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845ccd3e-9207-4e2d-b615-c2b617b012c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08781ab7-f47b-479b-a287-e74dbbb029cc', 'volume_name': 'volume-08781ab7-f47b-479b-a287-e74dbbb029cc', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f415ad10-2d75-4e59-a125-e7fe5cb4dd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f415ad10-2d75-4e59-a125-e7fe5cb4dd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e48e4b-1ea3-494f-9070-b9099d4cdc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:15 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Volume 08781ab7-f47b-479b-a287-e74dbbb029cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08781ab7-f47b-479b-a287-e74dbbb029cc', 'volume_size': 1}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-108685412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08781ab7-f47b-479b-a287-e74dbbb029cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cdc051556f46729ed61fae5a2ce6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:07:15Z,use_quota=True,user_id='035c3baa04d4441c9de2898272262f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Creating volume 08781ab7-f47b-479b-a287-e74dbbb029cc {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:07:15 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:15 devstack sudo[90691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc 1073741824
Apr 24 20:07:15 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Volume volume-301cc3b9-0593-40db-8e16-60ffa1078666 (301cc3b9-0593-40db-8e16-60ffa1078666): created successfully
Apr 24 20:07:15 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9216e30b-6c36-4bc9-ab6c-ab3e76cc49b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Flow 'volume_create_manager' (23cd117b-1e86-4b96-af9b-dcdbd89be0f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:07:15 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-197c06b8-0f6b-43a2-a882-1aa3adbebcc8 tempest-CinderUnicodeTest-1382036803 None] Created volume successfully.
Apr 24 20:07:15 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19.a8df2dde-a26a-4428-bb28-4da49ddc94d2" returned: 0 in 0.569s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-a8df2dde-a26a-4428-bb28-4da49ddc94d2" released by "_delete_snapshot" :: held 3.299s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-4ab9c9f0-e0dc-488a-b492-0277716c3e19" released by "delete_snapshot" :: held 3.334s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Created reservations ['e10bc2a7-3dae-4173-813f-646f0226a1b8', 'dfd1b456-8d5b-41e8-8079-54ad0505d673', 'e23c5179-65ce-46cd-9ad6-a14276bedfb5', '42e6a9c1-94e7-4258-a62b-029354946391'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:15 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Delete snapshot completed successfully.
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bde81f66-f664-4130-8f4c-de305a681a9c tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-a8df2dde-a26a-4428-bb28-4da49ddc94d2-delete_snapshot" released by "delete_snapshot" :: held 3.498s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:15 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc 1073741824" returned: 0 in 0.765s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:15 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:15 devstack sudo[90697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc
Apr 24 20:07:15 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Flow 'volume_create_manager' (82aeaf79-0545-4da4-9fc8-64bae9c0db9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f21b42-38b1-4b39-8092-cd8aac9760ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f21b42-38b1-4b39-8092-cd8aac9760ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-454469411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add159d4-030c-4490-9091-7ad60f2dc7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b33714fccf4462baa90c1141e9c505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:07:16Z,use_quota=True,user_id='643bab2240dd462592eb86585c08aacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b45e769-a2e5-433f-97ec-949dfd3253f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b45e769-a2e5-433f-97ec-949dfd3253f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2fc647c-58ea-4a95-ac85-12297523fb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2fc647c-58ea-4a95-ac85-12297523fb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add159d4-030c-4490-9091-7ad60f2dc7a6', 'volume_name': 'volume-add159d4-030c-4490-9091-7ad60f2dc7a6', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80f41db-0046-4a4c-9e3b-19da2c7a5042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80f41db-0046-4a4c-9e3b-19da2c7a5042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf40c28-d577-4021-beac-ef3a066cf855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:16 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Volume add159d4-030c-4490-9091-7ad60f2dc7a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add159d4-030c-4490-9091-7ad60f2dc7a6', 'volume_size': 1}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:16 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc" returned: 0 in 0.466s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.667s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e48e4b-1ea3-494f-9070-b9099d4cdc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08781ab7-f47b-479b-a287-e74dbbb029cc', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954098c4-e474-46fd-8998-0cb3ee6efa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] Creating offline snapshot 46490cbb-69ca-4563-bd5d-93df4372776c of volume 301cc3b9-0593-40db-8e16-60ffa1078666 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:07:16 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Volume volume-08781ab7-f47b-479b-a287-e74dbbb029cc (08781ab7-f47b-479b-a287-e74dbbb029cc): created successfully
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954098c4-e474-46fd-8998-0cb3ee6efa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Flow 'volume_create_manager' (185e8f7e-5b34-4afc-83cd-8af54a73216f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3888f5c1-7287-4eec-8d7b-d3e61065be06]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:16 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-68ba23aa-ad63-4134-bab3-79c7418d1bde tempest-VolumeDependencyTests-196650729 None] Created volume successfully.
Apr 24 20:07:16 devstack sudo[90700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666
Apr 24 20:07:16 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-4ab9c9f0-e0dc-488a-b492-0277716c3e19-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-4ab9c9f0-e0dc-488a-b492-0277716c3e19-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "cinder-quobyte-4ab9c9f0-e0dc-488a-b492-0277716c3e19" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-4ab9c9f0-e0dc-488a-b492-0277716c3e19" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd5359c-9320-4bda-b472-f2666453e5dd]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:16 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:16 devstack sudo[90702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19
Apr 24 20:07:16 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:17 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666" returned: 0 in 0.595s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:17 devstack sudo[90707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c 1G
Apr 24 20:07:17 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Flow 'volume_create_manager' (eaf5044a-be75-4dc5-aa6d-430647f5ccf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676658a4-7cda-4d42-899c-8240552f4d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676658a4-7cda-4d42-899c-8240552f4d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-338353232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e5be9d-c60b-4e5b-b1e4-922e1d9df818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cdc051556f46729ed61fae5a2ce6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=08781ab7-f47b-479b-a287-e74dbbb029cc,status='creating',terminated_at=None,updated_at=2026-04-24T18:07:17Z,use_quota=True,user_id='035c3baa04d4441c9de2898272262f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea0cb10-a41e-4630-bc2b-95b3aa8040fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:17 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea0cb10-a41e-4630-bc2b-95b3aa8040fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc12e015-5a2d-43ef-9d3d-b5555bc84bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19" returned: 0 in 0.654s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:17 devstack sudo[90715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19
Apr 24 20:07:17 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc12e015-5a2d-43ef-9d3d-b5555bc84bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b6e5be9d-c60b-4e5b-b1e4-922e1d9df818', 'volume_name': 'volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818', 'volume_size': 1, 'source_volid': '08781ab7-f47b-479b-a287-e74dbbb029cc', 'source_volstatus': 'available'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33749bf-c2e7-47df-9107-4f2f2a67cc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33749bf-c2e7-47df-9107-4f2f2a67cc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75286412-4c55-4198-94ed-0033641830f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:17 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Volume b6e5be9d-c60b-4e5b-b1e4-922e1d9df818: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818', 'volume_size': 1, 'source_volid': '08781ab7-f47b-479b-a287-e74dbbb029cc', 'source_volstatus': 'available'}
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:17 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c 1G" returned: 0 in 0.655s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301cc3b9-0593-40db-8e16-60ffa1078666 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:17 devstack sudo[90717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301cc3b9-0593-40db-8e16-60ffa1078666 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c
Apr 24 20:07:17 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:17 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-4ab9c9f0-e0dc-488a-b492-0277716c3e19" returned: 0 in 0.459s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:17 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-quobyte-4ab9c9f0-e0dc-488a-b492-0277716c3e19" released by "delete_volume" :: held 1.185s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:18 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Created reservations ['fdbeb7ba-d8bb-4b20-813c-75455edce6db', '76b522e3-b0a7-44ae-8e3c-05a44336aec2', '6071feef-66bd-4412-bc16-b47d040d1777', '1a2b7746-b254-400f-8165-7eb4f9368dfb'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:18 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:18 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:18 devstack sudo[90720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:18 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:18 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301cc3b9-0593-40db-8e16-60ffa1078666 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c" returned: 0 in 0.552s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:18 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c is being set with open permissions: ugo+rw
Apr 24 20:07:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:18 devstack sudo[90725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c
Apr 24 20:07:18 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:18 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.460s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:18 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:18 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Deleted volume successfully.
Apr 24 20:07:18 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-0c0bba25-58b3-40ff-b0dc-7c55e7ae9a07 tempest-CreateVolumesFromSnapshotTest-201793910 None] Lock "cinder-4ab9c9f0-e0dc-488a-b492-0277716c3e19-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:18 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c" returned: 0 in 0.482s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:18 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:18 devstack sudo[90729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.info
Apr 24 20:07:18 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:19 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.info" returned: 0 in 0.512s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:19 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.info is being set with open permissions: ugo+rw
Apr 24 20:07:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:19 devstack sudo[90738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.info
Apr 24 20:07:19 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:19 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.info" returned: 0 in 0.475s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.374s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.572s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f02e80986a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-454469411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add159d4-030c-4490-9091-7ad60f2dc7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b33714fccf4462baa90c1141e9c505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:07:16Z,use_quota=True,user_id='643bab2240dd462592eb86585c08aacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)}" {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 20:07:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Creating volume add159d4-030c-4490-9091-7ad60f2dc7a6 {{(pid=81241) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 20:07:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:19 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:07:19 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] casted to osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e
Apr 24 20:07:19 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6 1073741824 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:19 devstack sudo[90742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6 1073741824
Apr 24 20:07:19 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:19 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-e0aff559-0dda-452d-88ff-6089a4303d86 tempest-CinderUnicodeTest-1382036803 None] Create snapshot completed successfully
Apr 24 20:07:20 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6 1073741824" returned: 0 in 0.854s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:20 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=149,cinder:UPDATE=229,cinder:DELETE=21,cinder:INSERT=43 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:07:20 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=170,cinder:INSERT=61,cinder:UPDATE=223,cinder:DELETE=22 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:07:20 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:20 devstack sudo[90748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6
Apr 24 20:07:20 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Acquiring lock "cinder-46490cbb-69ca-4563-bd5d-93df4372776c-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Lock "cinder-46490cbb-69ca-4563-bd5d-93df4372776c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Acquiring lock "cinder-quobyte-301cc3b9-0593-40db-8e16-60ffa1078666" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Lock "cinder-quobyte-301cc3b9-0593-40db-8e16-60ffa1078666" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Acquiring lock "cinder-quobyte-46490cbb-69ca-4563-bd5d-93df4372776c" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:20 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Lock "cinder-quobyte-46490cbb-69ca-4563-bd5d-93df4372776c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:20 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Deleting offline snapshot 46490cbb-69ca-4563-bd5d-93df4372776c of volume 301cc3b9-0593-40db-8e16-60ffa1078666 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] snapshot_file for this snap is: volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2280accb-b90f-4b1f-9a78-78d45d6e61cb]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:21 devstack sudo[90750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c
Apr 24 20:07:21 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:21 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6" returned: 0 in 0.497s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'} {{(pid=81241) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.596s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:21 devstack cinder-volume[81241]: INFO cinder.volume.drivers.remotefs [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Cloning volume 08781ab7-f47b-479b-a287-e74dbbb029cc to volume b6e5be9d-c60b-4e5b-b1e4-922e1d9df818
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf40c28-d577-4021-beac-ef3a066cf855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add159d4-030c-4490-9091-7ad60f2dc7a6', 'volume_size': 1}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21bd4f9-f4a1-410b-942d-fc0a298be9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:21 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Volume volume-add159d4-030c-4490-9091-7ad60f2dc7a6 (add159d4-030c-4490-9091-7ad60f2dc7a6): created successfully
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21bd4f9-f4a1-410b-942d-fc0a298be9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Flow 'volume_create_manager' (82aeaf79-0545-4da4-9fc8-64bae9c0db9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Creating offline snapshot 1b886d6c-d2e9-4502-911c-0ef6107d8a03 of volume 08781ab7-f47b-479b-a287-e74dbbb029cc {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:07:21 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8b262214-045d-477e-aa34-7b4087933115 tempest-SnapshotDependencyTests-613411277 None] Created volume successfully.
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9f9399-f2b5-43f3-8d47-f5749299832d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:21 devstack sudo[90753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc
Apr 24 20:07:21 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:21 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c" returned: 0 in 0.610s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301cc3b9-0593-40db-8e16-60ffa1078666(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[361d1158-cd55-4235-a82c-78e1fe351fcc]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:21 devstack sudo[90758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666
Apr 24 20:07:21 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:21 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc" returned: 0 in 0.604s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:21 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:21 devstack sudo[90763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03 1G
Apr 24 20:07:21 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:22 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666" returned: 0 in 0.582s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:22 devstack sudo[90768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c
Apr 24 20:07:22 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:22 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03 1G" returned: 0 in 0.666s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08781ab7-f47b-479b-a287-e74dbbb029cc -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:22 devstack sudo[90773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08781ab7-f47b-479b-a287-e74dbbb029cc -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03
Apr 24 20:07:22 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:22 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c" returned: 0 in 0.585s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:22 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:22 devstack sudo[90780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c
Apr 24 20:07:22 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:23 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08781ab7-f47b-479b-a287-e74dbbb029cc -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03" returned: 0 in 0.525s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:23 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03 is being set with open permissions: ugo+rw
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:23 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03
Apr 24 20:07:23 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:23 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666.46490cbb-69ca-4563-bd5d-93df4372776c" returned: 0 in 0.459s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Lock "cinder-quobyte-46490cbb-69ca-4563-bd5d-93df4372776c" released by "_delete_snapshot" :: held 2.355s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Lock "cinder-quobyte-301cc3b9-0593-40db-8e16-60ffa1078666" released by "delete_snapshot" :: held 2.383s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Created reservations ['f616873f-b44d-484a-a104-3fe11ba0b5e7', 'e18850a2-a491-4d6d-861d-6e1d26315cc3', 'f3b71b15-6974-4c1a-824d-104d62a5cf1a', 'c878100e-7658-42a3-bc2f-ba528895ffb4'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:23 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Delete snapshot completed successfully.
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-12056213-4752-48d6-8abc-ddc8d0220843 tempest-CinderUnicodeTest-1382036803 None] Lock "cinder-46490cbb-69ca-4563-bd5d-93df4372776c-delete_snapshot" released by "delete_snapshot" :: held 2.511s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:23 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03" returned: 0 in 0.475s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:23 devstack sudo[90789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.info
Apr 24 20:07:23 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG oslo_service.periodic_task [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:23 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:24 devstack sudo[90792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:24 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:24 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.info" returned: 0 in 0.491s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:24 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.info is being set with open permissions: ugo+rw
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:24 devstack sudo[90794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.info
Apr 24 20:07:24 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Acquiring lock "cinder-301cc3b9-0593-40db-8e16-60ffa1078666-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Lock "cinder-301cc3b9-0593-40db-8e16-60ffa1078666-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Acquiring lock "cinder-quobyte-301cc3b9-0593-40db-8e16-60ffa1078666" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Lock "cinder-quobyte-301cc3b9-0593-40db-8e16-60ffa1078666" acquired by "delete_volume" :: waited 0.024s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a9629c-145b-4aa2-926c-efe91a7e1def]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:24 devstack sudo[90796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666
Apr 24 20:07:24 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:24 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.437s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-f424cdf9-d5d3-462e-9281-5cede264863c None None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:24 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.info" returned: 0 in 0.503s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-quobyte-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818" by "_copy_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] snapshot: 1b886d6c-d2e9-4502-911c-0ef6107d8a03, volume: b6e5be9d-c60b-4e5b-b1e4-922e1d9df818,  {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e270a1f3-b1d2-45df-8705-bedb34d7ec53]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:24 devstack sudo[90800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03
Apr 24 20:07:24 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:24 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666" returned: 0 in 0.551s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:24 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:24 devstack sudo[90805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666
Apr 24 20:07:24 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:25 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03" returned: 0 in 0.577s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08781ab7-f47b-479b-a287-e74dbbb029cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Creating direct copy from snapshot {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b947a7-dbfd-406b-b0ec-a0814efb939d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:25 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-301cc3b9-0593-40db-8e16-60ffa1078666" returned: 0 in 0.443s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Lock "cinder-quobyte-301cc3b9-0593-40db-8e16-60ffa1078666" released by "delete_volume" :: held 1.060s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:25 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc
Apr 24 20:07:25 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Created reservations ['3beedf54-4c8d-4a25-9140-957cd8bdec50', '26ca0ec2-2330-42fe-befa-cce85015141c', 'e5211c3f-dd58-4ccf-bec9-10c097d7309b', 'a2c9b4d6-85c9-4ed0-adf8-1d7ba7f29bbb'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:25 devstack sudo[90813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:25 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:25 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc" returned: 0 in 0.546s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG cinder.utils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Path /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818 not found in is_blk_device check {{(pid=81241) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:25 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.430s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:25 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Deleted volume successfully.
Apr 24 20:07:25 devstack sudo[90819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818
Apr 24 20:07:25 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:25 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-8a7dee20-904d-4d00-ba4b-2a389eccdb08 tempest-CinderUnicodeTest-1382036803 None] Lock "cinder-301cc3b9-0593-40db-8e16-60ffa1078666-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Acquiring lock "cinder-fcf30a89-2048-4a01-94aa-4b2ae112a377-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Lock "cinder-fcf30a89-2048-4a01-94aa-4b2ae112a377-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Acquiring lock "cinder-quobyte-fcf30a89-2048-4a01-94aa-4b2ae112a377" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:26 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Lock "cinder-quobyte-fcf30a89-2048-4a01-94aa-4b2ae112a377" acquired by "delete_volume" :: waited 0.023s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:26 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8455d940-f120-44de-8517-c344c3221306]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:26 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fcf30a89-2048-4a01-94aa-4b2ae112a377 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:26 devstack sudo[90830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fcf30a89-2048-4a01-94aa-4b2ae112a377
Apr 24 20:07:26 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:27 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fcf30a89-2048-4a01-94aa-4b2ae112a377" returned: 0 in 1.295s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:27 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fcf30a89-2048-4a01-94aa-4b2ae112a377 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:27 devstack sudo[90836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fcf30a89-2048-4a01-94aa-4b2ae112a377
Apr 24 20:07:27 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:28 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-fcf30a89-2048-4a01-94aa-4b2ae112a377" returned: 0 in 0.791s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:28 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Lock "cinder-quobyte-fcf30a89-2048-4a01-94aa-4b2ae112a377" released by "delete_volume" :: held 2.158s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:28 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Created reservations ['b1069995-35ef-4953-85f4-38edc11a8611', '88279eef-604c-481d-9311-db4fe0d38cb2', '3c66c528-2c97-42d1-ac80-130c15890cd2', '06145faa-aebb-42ba-b4f1-0c0304022456'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:28 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:28 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:28 devstack sudo[90839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:28 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:30 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 1.464s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:30 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:30 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Deleted volume successfully.
Apr 24 20:07:30 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-7b40ec43-1fef-4942-b6d9-1c780b1667f3 tempest-CinderUnicodeTest-1382036803 None] Lock "cinder-fcf30a89-2048-4a01-94aa-4b2ae112a377-delete_volume" released by "delete_volume" :: held 3.933s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:30 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818" returned: 0 in 5.026s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:30 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf5b458-e3ec-4072-bef7-5ee1f3b05489]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:30 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:30 devstack sudo[90843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc
Apr 24 20:07:30 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:31 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc" returned: 0 in 0.748s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:31 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818 {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 20:07:31 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Converted 1024.00 MB image at 203.72 MB/s
Apr 24 20:07:31 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818 is being set with open permissions: ugo+rw
Apr 24 20:07:31 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:31 devstack sudo[90848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818
Apr 24 20:07:31 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:32 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818" returned: 0 in 0.446s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818" released by "_copy_volume_from_snapshot" :: held 7.430s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-quobyte-1b886d6c-d2e9-4502-911c-0ef6107d8a03" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:32 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-1b886d6c-d2e9-4502-911c-0ef6107d8a03" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Deleting offline snapshot 1b886d6c-d2e9-4502-911c-0ef6107d8a03 of volume 08781ab7-f47b-479b-a287-e74dbbb029cc {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:07:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] snapshot_file for this snap is: volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:07:32 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e666b6d-cbd4-4e5d-a637-3a64092cd69b]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:32 devstack sudo[90851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03
Apr 24 20:07:32 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:32 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03" returned: 0 in 0.539s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:32 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08781ab7-f47b-479b-a287-e74dbbb029cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:07:32 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[963db3af-c740-49a5-a662-5662f90952e6]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:32 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:32 devstack sudo[90856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc
Apr 24 20:07:32 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:33 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc" returned: 0 in 0.505s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:33 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03
Apr 24 20:07:33 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:33 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03" returned: 0 in 0.510s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:33 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:33 devstack sudo[90866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03
Apr 24 20:07:33 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:34 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc.1b886d6c-d2e9-4502-911c-0ef6107d8a03" returned: 0 in 0.458s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-1b886d6c-d2e9-4502-911c-0ef6107d8a03" released by "_delete_snapshot" :: held 2.102s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.031s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.493s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75286412-4c55-4198-94ed-0033641830f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818', 'volume_size': 1, 'source_volid': '08781ab7-f47b-479b-a287-e74dbbb029cc', 'source_volstatus': 'available'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232bcb2e-4719-4ce7-b292-0f0c6dba8926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] Creating offline snapshot 9b674a92-a432-455b-be12-06356d2405e6 of volume add159d4-030c-4490-9091-7ad60f2dc7a6 {{(pid=81241) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 20:07:34 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Volume volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818 (b6e5be9d-c60b-4e5b-b1e4-922e1d9df818): created successfully
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232bcb2e-4719-4ce7-b292-0f0c6dba8926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Flow 'volume_create_manager' (eaf5044a-be75-4dc5-aa6d-430647f5ccf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[73988f35-359c-4442-a22a-27fc980eaed1]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:34 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-44a1b6a7-156c-478b-bdd1-bde1d9bb9641 tempest-VolumeDependencyTests-196650729 None] Created volume successfully.
Apr 24 20:07:34 devstack sudo[90869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6
Apr 24 20:07:34 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-08781ab7-f47b-479b-a287-e74dbbb029cc-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-08781ab7-f47b-479b-a287-e74dbbb029cc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-quobyte-08781ab7-f47b-479b-a287-e74dbbb029cc" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-08781ab7-f47b-479b-a287-e74dbbb029cc" acquired by "delete_volume" :: waited 0.025s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdd0044-3e36-4b60-b677-720866118d66]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:34 devstack sudo[90871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc
Apr 24 20:07:34 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:34 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6" returned: 0 in 0.589s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:34 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6 1G {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:34 devstack sudo[90876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6 1G
Apr 24 20:07:34 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:35 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc" returned: 0 in 0.538s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:35 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc
Apr 24 20:07:35 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:35 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6 1G" returned: 0 in 0.577s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add159d4-030c-4490-9091-7ad60f2dc7a6 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:35 devstack sudo[90886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add159d4-030c-4490-9091-7ad60f2dc7a6 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6
Apr 24 20:07:35 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:35 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-08781ab7-f47b-479b-a287-e74dbbb029cc" returned: 0 in 0.479s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-08781ab7-f47b-479b-a287-e74dbbb029cc" released by "delete_volume" :: held 1.072s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Created reservations ['f954af7a-9f3f-41a9-94a0-6cdcd0b96001', '3ab9a115-7c47-4c52-8944-c42d9c4f18a6', 'a6fd6267-3784-409b-8293-cce0ea54cb8d', 'd1025e21-9836-4523-a34a-e463c68d0502'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:35 devstack sudo[90891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:35 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:35 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add159d4-030c-4490-9091-7ad60f2dc7a6 -F qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6" returned: 0 in 0.507s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:35 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6 is being set with open permissions: ugo+rw
Apr 24 20:07:35 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:35 devstack sudo[90894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6
Apr 24 20:07:35 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:36 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.473s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:36 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:36 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Deleted volume successfully.
Apr 24 20:07:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-08a2c8fd-dca3-4a42-b820-08ecf8ded006 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-08781ab7-f47b-479b-a287-e74dbbb029cc-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:36 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6" returned: 0 in 0.473s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:36 devstack sudo[90898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.info
Apr 24 20:07:36 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-quobyte-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:36 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818" acquired by "delete_volume" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:36 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d500fcc0-dab5-464b-9ba0-1fcb9590be50]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:36 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.info" returned: 0 in 0.487s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:36 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.info is being set with open permissions: ugo+rw
Apr 24 20:07:36 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.info {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:36 devstack sudo[90901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818
Apr 24 20:07:36 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:36 devstack sudo[90903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.info
Apr 24 20:07:36 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:37 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818" returned: 0 in 0.498s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:37 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:37 devstack sudo[90909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818
Apr 24 20:07:37 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.info" returned: 0 in 0.455s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.198s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:37 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-9cbd0f90-1ea7-42cf-a3d3-ef6df5dcc5d2 tempest-SnapshotDependencyTests-613411277 None] Create snapshot completed successfully
Apr 24 20:07:37 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818" returned: 0 in 0.432s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:37 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818" released by "delete_volume" :: held 0.968s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:37 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Created reservations ['7334adc8-d3e4-4280-8e92-1cf9980bdfc4', '86cf057a-8a67-416f-9922-755b44ff3aee', 'd64bc82d-2e0e-4b13-a766-87d909e3665c', '6b79dc62-d2d5-486d-832f-d5e575a92ff9'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:37 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:37 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:37 devstack sudo[90912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:37 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:38 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.415s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:38 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Deleted volume successfully.
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-a84d053a-fb7b-4349-af9c-0eb498bdc2c6 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-b6e5be9d-c60b-4e5b-b1e4-922e1d9df818-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.flows.manager.create_volume [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81241) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Flow 'volume_create_manager' (1b5dc986-8373-4954-865f-3675cc812733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6808ae9d-d970-461a-b2ff-fd132f56a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6808ae9d-d970-461a-b2ff-fd132f56a132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T18:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6f2356-f6b7-48ab-a266-e36bb4c92f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b33714fccf4462baa90c1141e9c505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9b674a92-a432-455b-be12-06356d2405e6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:07:39Z,use_quota=True,user_id='643bab2240dd462592eb86585c08aacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2be1a04-2f21-4866-908a-42c52423064b),volume_type_id=c2be1a04-2f21-4866-908a-42c52423064b)' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5f7773-78f5-47fb-99fa-326f012630bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5f7773-78f5-47fb-99fa-326f012630bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a784fe-335b-4a6e-bbc9-a82a7d74c508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a784fe-335b-4a6e-bbc9-a82a7d74c508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3b6f2356-f6b7-48ab-a266-e36bb4c92f61', 'volume_name': 'volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61', 'volume_size': 1, 'snapshot_id': '9b674a92-a432-455b-be12-06356d2405e6'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82af4291-36d5-4c55-acd3-6425b8533dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82af4291-36d5-4c55-acd3-6425b8533dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80982c05-c11a-480a-9ac9-b559bd8ffada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:38 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Volume 3b6f2356-f6b7-48ab-a266-e36bb4c92f61: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61', 'volume_size': 1, 'snapshot_id': '9b674a92-a432-455b-be12-06356d2405e6'}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "cinder-quobyte-9b674a92-a432-455b-be12-06356d2405e6-3b6f2356-f6b7-48ab-a266-e36bb4c92f61" by "_create_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-quobyte-9b674a92-a432-455b-be12-06356d2405e6-3b6f2356-f6b7-48ab-a266-e36bb4c92f61" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Creating volume 3b6f2356-f6b7-48ab-a266-e36bb4c92f61 from snapshot 9b674a92-a432-455b-be12-06356d2405e6 {{(pid=81241) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Selected osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e as target Quobyte volume. {{(pid=81241) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "cinder-quobyte-3b6f2356-f6b7-48ab-a266-e36bb4c92f61" by "_copy_volume_from_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-quobyte-3b6f2356-f6b7-48ab-a266-e36bb4c92f61" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] snapshot: 9b674a92-a432-455b-be12-06356d2405e6, volume: 3b6f2356-f6b7-48ab-a266-e36bb4c92f61,  {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:38 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dcd573-0027-442e-9d01-25caa2da11d6]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-0b566472-f25a-444f-90a2-983a0d29665f-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-0b566472-f25a-444f-90a2-983a0d29665f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "cinder-quobyte-0b566472-f25a-444f-90a2-983a0d29665f" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:39 devstack sudo[90915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6
Apr 24 20:07:39 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-0b566472-f25a-444f-90a2-983a0d29665f" acquired by "delete_volume" :: waited 0.014s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[08766546-7dd8-4849-afb3-0b8845b430e9]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:39 devstack sudo[90917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f
Apr 24 20:07:39 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:39 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6" returned: 0 in 0.525s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-add159d4-030c-4490-9091-7ad60f2dc7a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] will copy from snapshot at /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6 {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Creating direct copy from snapshot {{(pid=81241) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9b38f1-eb07-49de-85ed-c4de5114d18d]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:39 devstack sudo[90923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6
Apr 24 20:07:39 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:39 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f" returned: 0 in 0.535s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:39 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:39 devstack sudo[90928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f
Apr 24 20:07:39 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:40 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6" returned: 0 in 0.531s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:40 devstack cinder-volume[81241]: DEBUG cinder.utils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Path /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61 not found in is_blk_device check {{(pid=81241) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 20:07:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:40 devstack sudo[90934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61
Apr 24 20:07:40 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:40 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-0b566472-f25a-444f-90a2-983a0d29665f" returned: 0 in 0.472s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:40 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-quobyte-0b566472-f25a-444f-90a2-983a0d29665f" released by "delete_volume" :: held 1.045s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:40 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Created reservations ['13d30b14-f7e2-4126-a23e-920e31eb43a9', '92cc0719-ce01-4da1-b7b9-5a12768407de', '5202940c-d416-4a8e-897e-eb81ab963d80', '06aa5b67-8d72-4a2e-8586-514ecbe33c7d'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:40 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:40 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:40 devstack sudo[90936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:40 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:40 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:40 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.678s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:40 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:40 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Deleted volume successfully.
Apr 24 20:07:41 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-3e73928b-227f-4176-a3f5-3c881f31a398 tempest-VolumeDependencyTests-196650729 None] Lock "cinder-0b566472-f25a-444f-90a2-983a0d29665f-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:45 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61" returned: 0 in 5.086s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:45 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[36345e44-aa87-4b5a-90e8-47bc3204c080]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:45 devstack sudo[90985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6
Apr 24 20:07:45 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:45 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6" returned: 0 in 0.629s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:45 devstack cinder-volume[81241]: DEBUG cinder.image.image_utils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Image conversion details: src /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6, size 1024.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61 {{(pid=81241) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 20:07:45 devstack cinder-volume[81241]: INFO cinder.image.image_utils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Converted 1024.00 MB image at 201.29 MB/s
Apr 24 20:07:45 devstack cinder-volume[81241]: WARNING cinder.volume.drivers.remotefs [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61 is being set with open permissions: ugo+rw
Apr 24 20:07:45 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:45 devstack sudo[90990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61
Apr 24 20:07:45 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:46 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61" returned: 0 in 0.452s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-quobyte-3b6f2356-f6b7-48ab-a266-e36bb4c92f61" released by "_copy_volume_from_snapshot" :: held 7.377s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:46 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-quobyte-9b674a92-a432-455b-be12-06356d2405e6-3b6f2356-f6b7-48ab-a266-e36bb4c92f61" released by "_create_volume_from_snapshot" :: held 7.407s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:46 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.422s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80982c05-c11a-480a-9ac9-b559bd8ffada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61', 'volume_size': 1, 'snapshot_id': '9b674a92-a432-455b-be12-06356d2405e6'}' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c2db25-c996-4cc0-abe0-a976aa526210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 20:07:46 devstack cinder-volume[81241]: INFO cinder.volume.flows.manager.create_volume [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Volume volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61 (3b6f2356-f6b7-48ab-a266-e36bb4c92f61): created successfully
Apr 24 20:07:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c2db25-c996-4cc0-abe0-a976aa526210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81241) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 20:07:46 devstack cinder-volume[81241]: DEBUG cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Flow 'volume_create_manager' (1b5dc986-8373-4954-865f-3675cc812733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81241) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 20:07:46 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-01fb0d91-c3d8-4891-ba04-ba09f593ef02 tempest-SnapshotDependencyTests-613411277 None] Created volume successfully.
Apr 24 20:07:47 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "cinder-9b674a92-a432-455b-be12-06356d2405e6-delete_snapshot" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:47 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-9b674a92-a432-455b-be12-06356d2405e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:47 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "cinder-quobyte-add159d4-030c-4490-9091-7ad60f2dc7a6" by "delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:47 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-quobyte-add159d4-030c-4490-9091-7ad60f2dc7a6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:47 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "cinder-quobyte-9b674a92-a432-455b-be12-06356d2405e6" by "_delete_snapshot" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:47 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-quobyte-9b674a92-a432-455b-be12-06356d2405e6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Deleting offline snapshot 9b674a92-a432-455b-be12-06356d2405e6 of volume add159d4-030c-4490-9091-7ad60f2dc7a6 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 20:07:47 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] snapshot_file for this snap is: volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6 {{(pid=81241) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 20:07:47 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[39247494-e6b1-4d98-b41a-e6055e3b8547]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:47 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:47 devstack sudo[90993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6
Apr 24 20:07:47 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:48 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6" returned: 0 in 0.516s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:48 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.remotefs [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-add159d4-030c-4490-9091-7ad60f2dc7a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81241) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 20:07:48 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6f7a47-b4b2-4801-8796-8df00a978dc0]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:48 devstack sudo[90998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6
Apr 24 20:07:48 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:48 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6" returned: 0 in 0.506s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:48 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:48 devstack sudo[91003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6
Apr 24 20:07:48 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:49 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6" returned: 0 in 0.527s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:49 devstack sudo[91008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6
Apr 24 20:07:49 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:49 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:49 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6.9b674a92-a432-455b-be12-06356d2405e6" returned: 0 in 0.427s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-quobyte-9b674a92-a432-455b-be12-06356d2405e6" released by "_delete_snapshot" :: held 2.066s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-quobyte-add159d4-030c-4490-9091-7ad60f2dc7a6" released by "delete_snapshot" :: held 2.087s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:49 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Created reservations ['f1c6c948-7ea8-4564-a8e0-4c7a96818d10', '13bf9af3-6fa3-4475-9314-e76e1dc9742a', '93c146d2-e055-473a-9747-6dc8320463f1', '6b9552e1-b562-4b65-b64f-c79b197cc23c'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:49 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Delete snapshot completed successfully.
Apr 24 20:07:49 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-d39696b0-d73e-422d-87f6-38f970451451 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-9b674a92-a432-455b-be12-06356d2405e6-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:50 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "cinder-add159d4-030c-4490-9091-7ad60f2dc7a6-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:50 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-add159d4-030c-4490-9091-7ad60f2dc7a6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:50 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "cinder-quobyte-add159d4-030c-4490-9091-7ad60f2dc7a6" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:50 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-quobyte-add159d4-030c-4490-9091-7ad60f2dc7a6" acquired by "delete_volume" :: waited 0.018s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:50 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1c84eb-76e9-4f42-805c-11b12e339863]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:50 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:50 devstack sudo[91012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6
Apr 24 20:07:50 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:51 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6" returned: 0 in 0.526s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:51 devstack sudo[91017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6
Apr 24 20:07:51 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:51 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-add159d4-030c-4490-9091-7ad60f2dc7a6" returned: 0 in 0.425s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:51 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-quobyte-add159d4-030c-4490-9091-7ad60f2dc7a6" released by "delete_volume" :: held 1.007s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:51 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Created reservations ['6f54ff48-2f4f-4898-854c-4c4d5c85ffdc', '93d21da8-b379-4102-84a3-9c275ef6336c', '2646e0b9-3c18-4fed-b0c4-02d2e8ca0795', '7dd05c65-bc69-4373-85a8-c26f4b5323a1'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:51 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:51 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:51 devstack sudo[91020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:51 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:52 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.422s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:52 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:52 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Deleted volume successfully.
Apr 24 20:07:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-bea140dd-ed61-4ddd-9db9-46abf84ec367 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-add159d4-030c-4490-9091-7ad60f2dc7a6-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "cinder-3b6f2356-f6b7-48ab-a266-e36bb4c92f61-delete_volume" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-3b6f2356-f6b7-48ab-a266-e36bb4c92f61-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "cinder-quobyte-3b6f2356-f6b7-48ab-a266-e36bb4c92f61" by "delete_volume" {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 20:07:52 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-quobyte-3b6f2356-f6b7-48ab-a266-e36bb4c92f61" acquired by "delete_volume" :: waited 0.017s {{(pid=81241) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 20:07:52 devstack cinder-volume[81241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a995e8e-d610-4704-9a19-3cf8852cffd1]: (4, 'qcow2') {{(pid=82087) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 20:07:52 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:53 devstack sudo[91023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61
Apr 24 20:07:53 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:53 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61" returned: 0 in 0.523s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:53 devstack sudo[91028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61
Apr 24 20:07:53 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:53 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:53 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883/volume-3b6f2356-f6b7-48ab-a266-e36bb4c92f61" returned: 0 in 0.429s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:53 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-quobyte-3b6f2356-f6b7-48ab-a266-e36bb4c92f61" released by "delete_volume" :: held 0.992s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:07:53 devstack cinder-volume[81241]: DEBUG cinder.quota [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Created reservations ['f724ba85-4d98-4077-ba3e-a1b97bc78ff8', '757a66b2-1c9d-4eac-9653-edda97ccffa5', 'c410138d-d0c0-420d-9e97-3dad045c9733', 'e401ae3f-cf97-48d8-b12a-f1c29f534595'] {{(pid=81241) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 20:07:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 20:07:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 20:07:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e': None} {{(pid=81241) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 20:07:54 devstack cinder-volume[81241]: DEBUG cinder.volume.drivers.quobyte [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-76ed7b31-d8f1-4986-846a-2a47bb20838e'] {{(pid=81241) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 20:07:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.lockutils [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 20:07:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883 {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 20:07:54 devstack sudo[91031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883
Apr 24 20:07:54 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 20:07:54 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root
Apr 24 20:07:54 devstack cinder-volume[81241]: DEBUG oslo_concurrency.processutils [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/099f1a4efd5a1ef45b5ade9ae878f883" returned: 0 in 0.435s {{(pid=81241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 20:07:54 devstack cinder-volume[81241]: DEBUG cinder.manager [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Notifying Schedulers of capabilities ... {{(pid=81241) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 20:07:54 devstack cinder-volume[81241]: INFO cinder.volume.manager [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Deleted volume successfully.
Apr 24 20:07:54 devstack cinder-volume[81241]: DEBUG cinder.coordination [None req-39ff01f4-17c2-4e9a-addb-cb96f4ed2a01 tempest-SnapshotDependencyTests-613411277 None] Lock "cinder-3b6f2356-f6b7-48ab-a266-e36bb4c92f61-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=81241) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 20:08:04 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=64,cinder:INSERT=24,cinder:UPDATE=67,cinder:DELETE=5 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 20:08:04 devstack cinder-volume[81241]: DEBUG dbcounter [-] [81241] Writing DB stats cinder:SELECT=47,cinder:UPDATE=86,cinder:INSERT=17,cinder:DELETE=6 {{(pid=81241) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}